-- Logs begin at Fri 2022-05-13 17:28:27 UTC, end at Fri 2022-05-13 19:24:50 UTC. -- May 13 18:11:55.493283 dv-cinder-839987-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 13 18:11:55.501316 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 18:11:55 2022] *** May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: nodename: dv-cinder-839987-3-iscsi May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: machine: x86_64 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: clock source: unix May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: pcre jit disabled May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: detected number of CPU cores: 4 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: current working directory: / May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: detected binary path: /usr/bin/uwsgi-core May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: your processes number limit is 47680 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: your memory page size is 4096 bytes May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: detected max file descriptor number: 2048 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: lock engine: pthread robust mutexes May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: thunder lock: enabled May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 13 18:11:55.511763 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 18:11:55.551929 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: Python main interpreter initialized at 0x55dbd587b9c0 May 13 18:11:55.551929 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: python threads support enabled May 13 18:11:55.551929 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: your server socket listen backlog is limited to 100 connections May 13 18:11:55.551929 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: your mercy for graceful operations on workers is 90 seconds May 13 18:11:55.552315 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: mapped 403077 bytes (393 KB) for 2 cores May 13 18:11:55.552391 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: *** Operational MODE: preforking *** May 13 18:11:55.552633 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: *** uWSGI is running in multiple interpreter mode *** May 13 18:11:55.552633 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: spawned uWSGI master process (pid: 79969) May 13 18:11:55.552852 dv-cinder-839987-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 13 18:11:55.555665 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: spawned uWSGI worker 1 (pid: 79983, cores: 1) May 13 18:11:55.555665 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: spawned uWSGI worker 2 (pid: 79984, cores: 1) May 13 18:11:55.555665 dv-cinder-839987-3-iscsi devstack@keystone.service[79969]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 18:12:01.314267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 18:12:01.314267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: from cryptography.utils import int_from_bytes May 13 18:12:01.315119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 18:12:01.315119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: from cryptography.utils import int_from_bytes May 13 18:12:01.315748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 18:12:01.315748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: from cryptography.utils import int_from_bytes May 13 18:12:01.316447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 18:12:01.316447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: from cryptography.utils import int_from_bytes May 13 18:12:01.365123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 18:12:01.365332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 18:12:01.365491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] command line args: [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 18:12:01.365764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 18:12:01.365970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 18:12:01.366056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ================================================================================ {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 18:12:01.366168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 18:12:01.366256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] admin_token = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.366362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] command line args: [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 18:12:01.366450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] config_dir = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.366627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.366708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 18:12:01.366786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ================================================================================ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 18:12:01.366863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] config_source = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.366977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] debug = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.367067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] admin_token = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.367177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config_dir = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config_source = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] debug = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.368971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_config_append = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_dir = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_file = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_config_append = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.369978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_dir = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.370969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.371968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.84/identity {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.372924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] publish_errors = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.84/identity {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] publish_errors = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.373978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] standard_threads = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.374868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.375487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.375604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.376351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.376351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] use_journal = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.376351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] use_json = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.376696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] standard_threads = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.376823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] use_stderr = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.376823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] use_syslog = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.377629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_journal = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.377881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_json = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.377881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_stderr = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.378119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.378244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_syslog = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.378360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.378474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 18:12:01.378588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.378703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.378829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.378946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.379925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.380898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.381014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.381491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.381611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.381738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.381876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.381993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.382954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.383888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.384966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.385906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.386940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.387995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.388945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.389909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.390021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.390118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.390214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.390310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.390411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.390508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.391173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.391724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.391958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.392988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.393915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.394985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.395914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.396978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.397930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.398967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.399914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.400976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.401955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.402910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.external = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.403975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.password = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.404945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] auth.token = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.external = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.405982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.406113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.406232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.406793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.406917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.password = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.token = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.407891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.408907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.409881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.410923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.411999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.412955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.413888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414361 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.414977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415814 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.415955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.416926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.417888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.418968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.419918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.420988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.421108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.421224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.421341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.421458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.421575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.421700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.422117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.422577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.422701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.422839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.422971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.423991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.424937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.425947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.426910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427378 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.427981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.428936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.429906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.430996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.431954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.432901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.433906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.434974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.435948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.436974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.437092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.437209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.437325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.437947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.438426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.438608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.438744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.438870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.438991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] role.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.439967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] role.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.440902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.441968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.442909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.443934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.444987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.445843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.446886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.447921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.448985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.449885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.450927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.451973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.connection = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.452893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.453995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.454942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.455982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.456919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 18:12:01.457015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 18:12:01.483787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.483985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.484075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.484199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.484329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.485065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.494365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.494534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.522801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.523025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.523118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.523278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.577842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.578027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.630966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.631207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.631852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.632094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.702950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.703798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.703916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.704852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.705079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.705301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.729341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.729521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.729596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.729843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.729940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.730826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.742830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.743273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.757627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.757950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.758099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.758234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.758370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.758502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.758732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.758893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.759033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.759183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.759317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79983) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.759466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.759466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.759466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 18:12:01.776750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.777027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 18:12:01.777190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.777190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 18:12:01.777451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.777451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 18:12:01.777788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.777788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 18:12:01.778100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.778233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.778427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.778621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.778621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.778892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.779069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.779222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.790766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.791939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.799853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.800053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.803131 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.803301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.803454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.803603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.803738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.803869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.804041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.804220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.804360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.804567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.804772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.804988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.805192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.805192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.805614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.805865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.806073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.806217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.806356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.806504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.806638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.806638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.832747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.834302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.834577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.839624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.839924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.840157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.840378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.841859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.842291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.848442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.848734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.848957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.849204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.849438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.853409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.853691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.853992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.854269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.854536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.854807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.855067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.855340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.856747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.857035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.861775 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.862189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.862373 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.862629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.862895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.863167 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.863431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.863948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.874432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.874718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.879446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.882530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.882838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.883088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.883382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.887317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.888342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.891993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.892289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.892482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.896234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.896532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.896811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.897112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.897254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.897389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.897641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.900772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.904494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.904790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.905070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.905349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.905632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.905918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.917122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.917505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.917781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.918038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.925445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.925856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.926130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.926311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.926465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.928016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.928287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.931308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.931582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.931869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.932145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.932413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.934220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.935932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.936208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.939298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.939578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.939861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.940137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.940419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.945765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.946062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.946340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.946616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.946890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.947182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.947451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.954383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.954656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.954933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.955221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.955499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.955779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.956060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.965776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.969139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.972441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.974065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.974402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.975688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.975959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.976245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.977695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.981015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.982646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.983646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.985013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.985281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.985426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.985884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.989341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.989625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.989921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.990191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.993434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.995046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.998262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.998549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.998831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.999103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.999303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:01.999604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:01.999959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.008361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79983) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:02.008636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.008912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.009052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:02.009182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.009364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.009448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.009649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.009733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.009984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.010255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.010518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.010788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.011052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.011315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.011582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.011834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79983) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.018200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 18:12:02.018476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.018755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.019029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.019297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.019582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.019857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.020133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.020407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.020672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.020937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.021199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.021470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.021725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 18:12:02.051059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dbd587b9c0 pid: 79983 (default app) May 13 18:12:02.054442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8087e-5e78-4788-8166-87b0d10d9326 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:02.054743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8087e-5e78-4788-8166-87b0d10d9326 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:02.055032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8087e-5e78-4788-8166-87b0d10d9326 None None] PATH_INFO: `/v3` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:02.059162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1/1] 10.222.0.84 () {50 vars in 791 bytes} [Fri May 13 18:12:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:02.068981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dbd587b9c0 pid: 79984 (default app) May 13 18:12:10.167635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6b38-69c0-483d-9f6d-3de947956e9a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:10.168600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6b38-69c0-483d-9f6d-3de947956e9a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:10.170752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6b38-69c0-483d-9f6d-3de947956e9a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:10.172562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 2/2] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:10.180839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:10.181338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:10.181570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:10.214284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG oslo_db.sqlalchemy.engines [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 18:12:10.411729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG passlib.handlers.bcrypt [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79984) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 18:12:10.412148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG passlib.handlers.bcrypt [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79984) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 18:12:10.472740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:10.474436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:10.632157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1/3] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 13 18:12:10.788500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee6b38-69c0-483d-9f6d-3de947956e9a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:10.829563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG oslo_db.sqlalchemy.engines [None req-3eee6b38-69c0-483d-9f6d-3de947956e9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 18:12:10.976782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee6b38-69c0-483d-9f6d-3de947956e9a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:10.981234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:10.981968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:10.982248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:10.982527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:10.993075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:11.046111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 18:12:11.046884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979cc58-3aac-4083-8ad6-59c339133188 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:11.057865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 3/4] 10.222.0.84 () {58 vars in 1324 bytes} [Fri May 13 18:12:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 18:12:11.064571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:11.079872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f99f6-6df9-4742-90db-a9ecc4570088 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:11.084475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:11.085623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:11.085947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:11.086222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] PATH_INFO: `/v3/projects/a135c41fcf464430b5b4b85603ac96eb` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:11.087731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] RBAC: Authorizing `identity:get_project(project_id=a135c41fcf464430b5b4b85603ac96eb)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:11.139320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 18:12:11.139658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64530b-382e-426f-9ee6-0c88b64594cf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:11.144764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 2/5] 10.222.0.84 () {56 vars in 1207 bytes} [Fri May 13 18:12:11 2022] GET /identity/v3/projects/a135c41fcf464430b5b4b85603ac96eb => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:13.464036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07f818-f378-47c6-ad65-4ece80df324c None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:13.464543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07f818-f378-47c6-ad65-4ece80df324c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:13.464647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07f818-f378-47c6-ad65-4ece80df324c None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:13.469467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 4/6] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:13.478081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:13.478081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:13.478687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:13.500878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:13.502716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:13.511235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 3/7] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 13 18:12:13.535955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07f818-f378-47c6-ad65-4ece80df324c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:13.549580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07f818-f378-47c6-ad65-4ece80df324c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:13.554298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9613f79-a8eb-4829-83cd-9888e65f60fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:13.554975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613f79-a8eb-4829-83cd-9888e65f60fa admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:13.555262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613f79-a8eb-4829-83cd-9888e65f60fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:13.555542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613f79-a8eb-4829-83cd-9888e65f60fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:13.565497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9613f79-a8eb-4829-83cd-9888e65f60fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:13.567500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9613f79-a8eb-4829-83cd-9888e65f60fa admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:13.578094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 5/8] 10.222.0.84 () {58 vars in 1324 bytes} [Fri May 13 18:12:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:12:13.584192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:13.594447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2726fb4-5ea3-4385-834c-0cc30dc0bced None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:13.599063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694fe91-04e1-4d9d-a5e3-bf95c0f70364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:13.599975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694fe91-04e1-4d9d-a5e3-bf95c0f70364 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:13.600257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694fe91-04e1-4d9d-a5e3-bf95c0f70364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:13.600530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694fe91-04e1-4d9d-a5e3-bf95c0f70364 admin admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:13.602045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694fe91-04e1-4d9d-a5e3-bf95c0f70364 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:13.603955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694fe91-04e1-4d9d-a5e3-bf95c0f70364 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:13.605784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 4/9] 10.222.0.84 () {56 vars in 1198 bytes} [Fri May 13 18:12:13 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:16.090014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221eec-3dd1-4215-97e8-5eddd23c6a7f None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.090795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221eec-3dd1-4215-97e8-5eddd23c6a7f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.090795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221eec-3dd1-4215-97e8-5eddd23c6a7f None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.091997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 6/10] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:16.099810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.100354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.100894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.109660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8810db-450d-44dd-a1de-588374236984 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.110096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8810db-450d-44dd-a1de-588374236984 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.110415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8810db-450d-44dd-a1de-588374236984 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.112107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 7/11] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:16.119071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.119497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.119992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.169037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG passlib.handlers.bcrypt [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79983) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 18:12:16.169473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG passlib.handlers.bcrypt [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79983) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 18:12:16.218079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:16.220340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:16.234805 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:16.236008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:16.344654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 5/12] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:16.356585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 8/13] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:16.369519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:16.379974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:16.507441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b352a3-f1b3-4c28-b4fa-32e3d3eaefd9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:16.521901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c196-b09d-4b09-a698-b8b8e2277abb None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:16.545145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:16.546930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.547348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.547791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.559384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:16.560293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.560581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.560859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.565390 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:16.580979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:16.581978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:16.582784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 6/14] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:16.588346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:16.640994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:16.642336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:16.716442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734de98-dddd-40a7-a8cb-9782f269f0e7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:16.757661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:16.758794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 9/15] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:12:16.759005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:16.759224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:16.759679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:16.760867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:16.761179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:16.762652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:16.764190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:16.778773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 7/16] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:16.785854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:16.961104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb6e6-2045-4fe9-b09e-4d442ee67069 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:17.012930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:17.013874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:17.014160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:17.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:17.016508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:17.016969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8c462-41dc-4047-8097-60e9dc668d0d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:17.018041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:17.019909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 8/17] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:16 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:17.025229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:17.078165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:17.079485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:17.080145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:17.080145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:17.104708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:17.106245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:12:17.129543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:17.130532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:17.131571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:12:17.131571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:12:17.131571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:12:17.131571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:17.134199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 10/18] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:12:17.136646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:17.157265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82ce4-c4b1-4e7b-98d5-0ca26ebdc507 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:17.198498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:17.199618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:17.200057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:17.200483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:17.202034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:17.204503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:17.206525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 9/19] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:17.212660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:17.274152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fac48e-45f5-4bcd-9350-0ffbbfde56b4 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:17.314603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:17.315559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:17.315999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:17.316422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:17.317312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:17.317768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:17.319361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e518b-a85d-4eaa-9b45-432ef2c96c33 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:17.322222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df95ee6-b1d3-4f2c-bbb0-63a6f4bfc86b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:17.338660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 11/20] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:17.360714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:17.361402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:17.361685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:17.361995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:17.362991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.domain.id=default, user.id=ec0fceb9f1a04ac58d3b3075178f7b1f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:17.363306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:17.365103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988ec3a-da45-4e15-a3e0-6dc7714255e9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:17.373358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 10/21] 10.222.0.84 () {56 vars in 1322 bytes} [Fri May 13 18:12:17 2022] GET /identity/v3/role_assignments?user.id=ec0fceb9f1a04ac58d3b3075178f7b1f&scope.domain.id=default&role.id=86c6955a20734baf912fede27a24309e => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:20.365776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307a3b-8ab4-44d2-b1fc-1ab9e1c124e7 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:20.367417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307a3b-8ab4-44d2-b1fc-1ab9e1c124e7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:20.368253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307a3b-8ab4-44d2-b1fc-1ab9e1c124e7 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:20.370911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 12/22] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:20.374048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b140a2d-1283-44d5-93dd-220afcc09547 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:20.375821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b140a2d-1283-44d5-93dd-220afcc09547 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:20.376439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b140a2d-1283-44d5-93dd-220afcc09547 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:20.378461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:20.378963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:20.379443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:20.380504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 11/23] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:20.398579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:20.399501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:20.399991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:20.418748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:20.420736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:20.447560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:20.450158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:20.657734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 13/24] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:20.660434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 12/25] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:20.700040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:20.731554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:20.875498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cd45a-29ee-4a4a-8e24-4849ce3db364 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:20.915078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:20.916239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:20.916747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:20.917241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:20.929356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:20.934345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f89f6-c8ca-4508-aabd-9108797d93ae None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:20.937932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:20.938817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:20.939579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:20.942436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 13/26] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:20.950756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:21.012602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:21.014009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.014526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.015061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.044659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:21.051611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:21.064953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e630d0-aa87-4ede-a2d4-99c635415a7a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:12:21.101476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:21.102398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:21.103187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:12:21.103187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:12:21.103187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:12:21.103187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:21.106120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:21.107050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.107628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.108108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.109626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:21.110162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:21.111798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:21.112354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 14/27] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:21.118911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:21.122713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 14/28] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:21.131705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:21.314702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e70e0-19bf-4b71-9353-ca9bd6b22a08 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:21.333814 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7af6-ad79-4158-859d-838f819bcc1c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:21.384346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:21.385448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.385966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.386440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.387812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:21.388356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:21.391549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:21.391689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:21.392466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.392925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.393344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.394773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:21.396448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:21.398804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 15/29] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:21 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:21.407228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:21.420191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 15/30] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:21.429430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:21.523366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282080c-5b2e-4eeb-9f81-839dc9db5e8c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:21.570514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535453b-546c-4ecb-85fc-193bb62e3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:21.571558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535453b-546c-4ecb-85fc-193bb62e3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.571986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535453b-546c-4ecb-85fc-193bb62e3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.572403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535453b-546c-4ecb-85fc-193bb62e3cc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.574961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535453b-546c-4ecb-85fc-193bb62e3cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:21.576634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535453b-546c-4ecb-85fc-193bb62e3cc0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:21.581049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 16/31] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:21.584098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52279cdf-584b-4372-a1d8-c14450c18b38 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.588417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52279cdf-584b-4372-a1d8-c14450c18b38 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.588918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52279cdf-584b-4372-a1d8-c14450c18b38 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.590637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 17/32] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:21.594084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52279cdf-584b-4372-a1d8-c14450c18b38 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:21.701593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef81744-a17c-4204-9d0b-f30f4cc8a067 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:21.791247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90c858-3150-4ac9-909d-5001c2d230df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:21.792173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90c858-3150-4ac9-909d-5001c2d230df None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:21.792626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90c858-3150-4ac9-909d-5001c2d230df None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:21.793046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90c858-3150-4ac9-909d-5001c2d230df None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:21.798243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90c858-3150-4ac9-909d-5001c2d230df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:21.799940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90c858-3150-4ac9-909d-5001c2d230df None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:21.905922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52279cdf-584b-4372-a1d8-c14450c18b38 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:22.022685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e04d81-6698-4f16-898e-693639e4bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:22.024244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e04d81-6698-4f16-898e-693639e4bdd0 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:22.024971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e04d81-6698-4f16-898e-693639e4bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:22.025685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e04d81-6698-4f16-898e-693639e4bdd0 None admin] PATH_INFO: `/v3/domains/default/users/ec0fceb9f1a04ac58d3b3075178f7b1f/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:22.028990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 16/33] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:12:21 2022] POST /identity/v3/projects => generated 301 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:22.031327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:22.031780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:22.032193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:22.034137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e04d81-6698-4f16-898e-693639e4bdd0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ec0fceb9f1a04ac58d3b3075178f7b1f, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:22.036976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e04d81-6698-4f16-898e-693639e4bdd0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:22.063442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:22.065041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:22.188859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 17/34] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:22.299161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:22.314241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 18/35] 10.222.0.84 () {58 vars in 1361 bytes} [Fri May 13 18:12:21 2022] PUT /identity/v3/domains/default/users/ec0fceb9f1a04ac58d3b3075178f7b1f/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:22.461587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0c15-4b1e-44dd-b465-d85dac312bb7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:22.521664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dec99-90e3-4125-b121-8c3fc403fbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:22.522824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dec99-90e3-4125-b121-8c3fc403fbe5 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:22.523340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dec99-90e3-4125-b121-8c3fc403fbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:22.523834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dec99-90e3-4125-b121-8c3fc403fbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:22.524857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dec99-90e3-4125-b121-8c3fc403fbe5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:22.526746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dec99-90e3-4125-b121-8c3fc403fbe5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:22.557714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 18/36] 10.222.0.84 () {60 vars in 1131 bytes} [Fri May 13 18:12:22 2022] POST /identity/v3/roles => generated 219 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:23.379460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c090aca-8057-4666-872f-630edf941894 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.380524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c090aca-8057-4666-872f-630edf941894 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.381017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c090aca-8057-4666-872f-630edf941894 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.386092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 19/37] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:23.392230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.394234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.394234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.410609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694aa37-6c62-4658-a806-c132213856a8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.411127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694aa37-6c62-4658-a806-c132213856a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.411546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694aa37-6c62-4658-a806-c132213856a8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.414816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 20/38] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:23.419677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.420201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.420622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.423627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:23.427141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:23.470999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:23.472567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:23.528874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 19/39] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:23.552933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:23.654587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902260-771d-49e1-a919-ac9887b4e678 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:23.659664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 21/40] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:23.693011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:23.694266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.694690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.695122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.696889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:23.697016 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:23.698679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:23.700849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 20/41] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:23.707457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:23.857006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ae20-1aff-435b-b185-466a8ae322ea None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:23.906714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceea8a-11cd-47c3-8c85-092229ef93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:23.907752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceea8a-11cd-47c3-8c85-092229ef93ae None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.908350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceea8a-11cd-47c3-8c85-092229ef93ae None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.908953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceea8a-11cd-47c3-8c85-092229ef93ae None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.910289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceea8a-11cd-47c3-8c85-092229ef93ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:23.912400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceea8a-11cd-47c3-8c85-092229ef93ae None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:23.934666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1f35-cef6-4f14-bb68-160b532a4d1c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:23.961902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 21/42] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:12:23 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:23.962360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabb12-f60e-4823-b39c-9b2492b829f8 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.962872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabb12-f60e-4823-b39c-9b2492b829f8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.963412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabb12-f60e-4823-b39c-9b2492b829f8 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:23.974106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 22/43] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:23.977256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81739cbc-6732-4dd2-9fe9-cc0adf5fcad5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:23.978218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81739cbc-6732-4dd2-9fe9-cc0adf5fcad5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:23.978923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81739cbc-6732-4dd2-9fe9-cc0adf5fcad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:24.010630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-81739cbc-6732-4dd2-9fe9-cc0adf5fcad5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:24.013592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-81739cbc-6732-4dd2-9fe9-cc0adf5fcad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:24.020574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:24.022654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:24.024392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:24.024857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:24.026991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:24.033142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:24.061102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 22/44] 10.222.0.84 () {60 vars in 1131 bytes} [Fri May 13 18:12:23 2022] POST /identity/v3/roles => generated 225 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:24.148496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 23/45] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:24.188292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:24.306601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ede1c0-4b70-4c4a-b292-a4b97c59103a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:24.349388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89a5d-37a2-4a41-a0c7-27de82dc03e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:24.353820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89a5d-37a2-4a41-a0c7-27de82dc03e0 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:24.353820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89a5d-37a2-4a41-a0c7-27de82dc03e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:24.353820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89a5d-37a2-4a41-a0c7-27de82dc03e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:24.353820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada89a5d-37a2-4a41-a0c7-27de82dc03e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:24.353820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada89a5d-37a2-4a41-a0c7-27de82dc03e0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:24.372700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 23/46] 10.222.0.84 () {60 vars in 1131 bytes} [Fri May 13 18:12:24 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:25.346958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cccd4a-413d-48e9-a254-196a38a38cd4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:25.347485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cccd4a-413d-48e9-a254-196a38a38cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:25.347562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cccd4a-413d-48e9-a254-196a38a38cd4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:25.349252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 24/47] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:25.354650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:25.355097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:25.355274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:25.374214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:25.375436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:25.445412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 24/48] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:25.470774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cccd4a-413d-48e9-a254-196a38a38cd4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:25.579920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cccd4a-413d-48e9-a254-196a38a38cd4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:25.619572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:25.620300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:25.620583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:25.620858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:25.632427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:25.642193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:25.643139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:25.643922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 25/49] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:25.649374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:25.751510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11395fa-ab67-4507-b6db-2368f7a42155 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:25.793601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:25.794324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:25.794612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:25.794896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:25.795811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:25.796712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:25.798392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:25.807457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 25/50] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:25.813731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:25.924843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0880abc-436a-4785-90ce-a7554443a958 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:25.964142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:25.965033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:25.965316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:25.965592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:25.967095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:25.968635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:25.970529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 26/51] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:25 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:25.975681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:26.085213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd8e70-3ec5-49fb-a734-d3e041136cba None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:26.129072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185b22-ac22-4242-9e23-b6d48de6872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:26.130426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185b22-ac22-4242-9e23-b6d48de6872b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:26.130899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185b22-ac22-4242-9e23-b6d48de6872b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:26.131360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185b22-ac22-4242-9e23-b6d48de6872b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:26.133353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83185b22-ac22-4242-9e23-b6d48de6872b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:26.135987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83185b22-ac22-4242-9e23-b6d48de6872b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:26.138422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 26/52] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:26.146082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:26.259483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1ccfa-5bd0-4639-a25e-6b587991cf42 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:26.295136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:26.295884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:26.296168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:26.296448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:26.297428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.domain.id=default, user.id=ec0fceb9f1a04ac58d3b3075178f7b1f) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:26.297752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:26.299261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286a4d-ee93-4355-ab25-3429f4406748 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:26.309910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 27/53] 10.222.0.84 () {56 vars in 1322 bytes} [Fri May 13 18:12:26 2022] GET /identity/v3/role_assignments?user.id=ec0fceb9f1a04ac58d3b3075178f7b1f&scope.domain.id=default&role.id=86c6955a20734baf912fede27a24309e => generated 530 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:26.563021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451ed2c-5601-4be5-8f66-f3076f658f89 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:26.563548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451ed2c-5601-4be5-8f66-f3076f658f89 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:26.563621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451ed2c-5601-4be5-8f66-f3076f658f89 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:26.565188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 27/54] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:12:26.573647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:26.574179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:26.574251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:26.602860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:26.604050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:26.741233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 28/55] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:26.766826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451ed2c-5601-4be5-8f66-f3076f658f89 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:26.894804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451ed2c-5601-4be5-8f66-f3076f658f89 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:26.939596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aec555-439c-4a97-9757-49988a86e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:26.940420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aec555-439c-4a97-9757-49988a86e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:26.940706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aec555-439c-4a97-9757-49988a86e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:26.940983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aec555-439c-4a97-9757-49988a86e9d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:26.942298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aec555-439c-4a97-9757-49988a86e9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:26.943781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aec555-439c-4a97-9757-49988a86e9d9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:26.945470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 28/56] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:26.951366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:27.096039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbde2a-d1a5-4ab8-aa0f-ba06f520f919 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:27.152264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd651aa5-b28d-48bf-a490-6c335ade4872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:27.153094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd651aa5-b28d-48bf-a490-6c335ade4872 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:27.153574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd651aa5-b28d-48bf-a490-6c335ade4872 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:27.154094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd651aa5-b28d-48bf-a490-6c335ade4872 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:27.154896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd651aa5-b28d-48bf-a490-6c335ade4872 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:27.158156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd651aa5-b28d-48bf-a490-6c335ade4872 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:27.199707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 29/57] 10.222.0.84 () {60 vars in 1140 bytes} [Fri May 13 18:12:26 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:29.521045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ae0ab-26d4-4ab8-958a-bce847f12b64 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:29.521612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ae0ab-26d4-4ab8-958a-bce847f12b64 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:29.521751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ae0ab-26d4-4ab8-958a-bce847f12b64 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:29.523411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 29/58] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:29.528891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:29.529349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:29.529468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:29.548070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:29.549268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:29.622790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 30/59] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:29.647740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ae0ab-26d4-4ab8-958a-bce847f12b64 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:29.757200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ae0ab-26d4-4ab8-958a-bce847f12b64 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:29.791429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085da37-86d7-4457-977c-f1937aa9f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:29.792218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085da37-86d7-4457-977c-f1937aa9f630 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:29.792505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085da37-86d7-4457-977c-f1937aa9f630 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:29.792786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085da37-86d7-4457-977c-f1937aa9f630 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:29.793998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085da37-86d7-4457-977c-f1937aa9f630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:29.795445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085da37-86d7-4457-977c-f1937aa9f630 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:29.797654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 30/60] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:29.803162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:29.902902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0697-dc71-4087-a61d-4d8cf27bf379 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:29.943885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbf1eb-79c8-4ac9-93fa-bcbb8bf55dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:29.944576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbf1eb-79c8-4ac9-93fa-bcbb8bf55dd4 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:29.944864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbf1eb-79c8-4ac9-93fa-bcbb8bf55dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:29.945152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbf1eb-79c8-4ac9-93fa-bcbb8bf55dd4 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:29.945967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbf1eb-79c8-4ac9-93fa-bcbb8bf55dd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:29.947448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbf1eb-79c8-4ac9-93fa-bcbb8bf55dd4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:29.973999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 31/61] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:12:29 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:12:33.418173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4ac8-8b1d-4bed-887f-2d00bb7b1888 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:33.419193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4ac8-8b1d-4bed-887f-2d00bb7b1888 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:33.419686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4ac8-8b1d-4bed-887f-2d00bb7b1888 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:33.422073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 31/62] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:33.428176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:33.428647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:33.428719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:33.457716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:33.460897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:33.551027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 32/63] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:33.596670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4ac8-8b1d-4bed-887f-2d00bb7b1888 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:33.741720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4ac8-8b1d-4bed-887f-2d00bb7b1888 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:33.781440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2bb3-9c16-4a77-b834-f293e379c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:33.782701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2bb3-9c16-4a77-b834-f293e379c798 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:33.783195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2bb3-9c16-4a77-b834-f293e379c798 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:33.783676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2bb3-9c16-4a77-b834-f293e379c798 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:33.796308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2bb3-9c16-4a77-b834-f293e379c798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-dece2bb3-9c16-4a77-b834-f293e379c798 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:33.805158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:33.806090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:33.806869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:33.809743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 32/64] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:33.816323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:33.948101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1651c-972d-4321-b335-b7f305426bed None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:33.989703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:33.990425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:33.990710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:33.990990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:33.991818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:33.992072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:33.993488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:34.011440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 33/65] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:34.013366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd940-ac87-4206-9967-b89692fb612a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.013906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd940-ac87-4206-9967-b89692fb612a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.015673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd940-ac87-4206-9967-b89692fb612a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.017314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 33/66] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:34.021925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:34.024108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.024639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.025162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.079828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:34.081888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:34.141658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e220a-7cb0-40fe-97ba-683298bd64bc None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:34.181223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:34.182144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.182429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.182711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.218504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:34.220383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:34.222596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 34/67] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:34 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:34.232082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:34.265187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 34/68] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:34.300619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:34.387090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417df92e-e349-4547-9b29-8ee9d4857d8d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:34.452522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee6494-7ad1-4ce9-8c52-eb6ea395e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:34.453307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee6494-7ad1-4ce9-8c52-eb6ea395e23b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.453496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee6494-7ad1-4ce9-8c52-eb6ea395e23b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.453784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee6494-7ad1-4ce9-8c52-eb6ea395e23b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.574902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec37a-27ea-4f8c-b10c-919bd4954041 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:34.606098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee6494-7ad1-4ce9-8c52-eb6ea395e23b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:34.607799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee6494-7ad1-4ce9-8c52-eb6ea395e23b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:34.636377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca1f17-1f2a-49e4-8a65-dca6a1dffce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:34.637198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca1f17-1f2a-49e4-8a65-dca6a1dffce6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.637486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca1f17-1f2a-49e4-8a65-dca6a1dffce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.637763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca1f17-1f2a-49e4-8a65-dca6a1dffce6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.660307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca1f17-1f2a-49e4-8a65-dca6a1dffce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-dbca1f17-1f2a-49e4-8a65-dca6a1dffce6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:34.669761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:34.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:34.672034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:34.685182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 35/69] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:12:34.687344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d926-96e4-4efd-b669-c3ce5c5cb0b9 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.687632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d926-96e4-4efd-b669-c3ce5c5cb0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.687911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d926-96e4-4efd-b669-c3ce5c5cb0b9 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.689284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 36/70] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:34.690011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d926-96e4-4efd-b669-c3ce5c5cb0b9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:34.783270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 35/71] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:12:34.784599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.785243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.785732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:34.803915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:34.805380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:34.898567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 36/72] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:34.899884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:34.931628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d926-96e4-4efd-b669-c3ce5c5cb0b9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:34.997921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:34.998787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:34.999258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:34.999413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.000404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:35.000889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.002552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.019370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53512-24bf-4f18-a9ad-11a1d49b6575 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.028365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 37/73] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:35.029552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.066189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.067532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.068107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.068646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.070768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.072748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.075098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 37/74] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:34 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:35.076178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.222888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5c1b-ec17-4851-a265-324afecd5a7b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.235112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295335b9-d670-4fce-adb1-95d4a03237c8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.271522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.272782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.273268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.273753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.275234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.276899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.279139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 38/75] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:35.281028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.290315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.291514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.292008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.292491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.307901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:35.320663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:35.321612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:35.322408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:35.331568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 38/76] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:35.331568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.398735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c780-c9b4-4fab-82ed-b37946f0b9ff None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.437271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.438524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.439039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.439537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.440698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=51f6a62015a94fde8755dbb4c39831e0) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:35.441270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.443066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e8a0d-a522-42b1-814f-edd95e2a61bd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.445733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad56d7-b5d7-475b-a3a8-17b86b517c0d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.450361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 39/77] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/role_assignments?user.id=51f6a62015a94fde8755dbb4c39831e0&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:35.452946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14245d-8d04-4105-ab80-589d05122000 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.454101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14245d-8d04-4105-ab80-589d05122000 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.454609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14245d-8d04-4105-ab80-589d05122000 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.456373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 40/78] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:35.458029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14245d-8d04-4105-ab80-589d05122000 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.506443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8c809-7c59-403d-a3c7-8fbf240f78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.507472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c809-7c59-403d-a3c7-8fbf240f78d9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.507969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c809-7c59-403d-a3c7-8fbf240f78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.508585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c809-7c59-403d-a3c7-8fbf240f78d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.590789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8c809-7c59-403d-a3c7-8fbf240f78d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.593773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8c809-7c59-403d-a3c7-8fbf240f78d9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.691461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14245d-8d04-4105-ab80-589d05122000 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.731203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 39/79] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:35.734654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.734887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.735426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.735891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.736239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.736608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.737089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.738168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:35.738952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.740899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4606-b1dc-4c5a-9603-783ed5ca3672 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.752424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 41/80] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:35.754133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2332fd-f7d7-44ed-8a09-48ce56d4002c None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.754586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2332fd-f7d7-44ed-8a09-48ce56d4002c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.755045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2332fd-f7d7-44ed-8a09-48ce56d4002c None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.756560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 42/81] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:35.757530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2332fd-f7d7-44ed-8a09-48ce56d4002c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.767251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:35.768569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:35.848661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 40/82] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:35.849880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:35.884206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2332fd-f7d7-44ed-8a09-48ce56d4002c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:35.924202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdceb6-35de-4583-9ec8-099da7826688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:35.925250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdceb6-35de-4583-9ec8-099da7826688 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.925649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdceb6-35de-4583-9ec8-099da7826688 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.926040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdceb6-35de-4583-9ec8-099da7826688 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.927489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdceb6-35de-4583-9ec8-099da7826688 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:35.929178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdceb6-35de-4583-9ec8-099da7826688 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:35.931287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 43/83] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:35.933503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:35.933503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:35.933503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:35.952794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:35.954182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:35.968457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d94b-57d6-4cd5-895c-f063e61df4b7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.005767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.007155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.007673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.008159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.010120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:36.011859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:36.014757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 41/84] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:35 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:36.015846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.034343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 44/85] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:36.035308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.133369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ec10-1479-4280-be68-92fd21e4353b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.145383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fecf48-ebe4-4eb7-af82-51721e959734 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.172433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.173640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.174150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.174639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.182702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.183392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.183680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.184015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.184939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=ec0fceb9f1a04ac58d3b3075178f7b1f) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:36.185267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:36.186916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:36.188741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:36.193452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 45/86] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:36 2022] GET /identity/v3/role_assignments?user.id=ec0fceb9f1a04ac58d3b3075178f7b1f&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:36.194434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:36.197706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:36.198826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:36.199654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:36.210148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 42/87] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:36.211371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.317813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fd323-ef77-4faa-8484-a1dafec42fe5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.357183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.358512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.358808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.359143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.438119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5c7bf-5203-48a0-8433-2d02c2a6f194 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.462662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:36.465829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:36.485307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.486316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.486607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.486931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.490893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:36.495463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:36.500626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 43/88] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:36.503306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.698912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 46/89] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:36.700198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.729726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a001-1496-4642-a8e5-8f6d440850c2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.841832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.841832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.841832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.841832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.842886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:36.842886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:36.842886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:36.865355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 44/90] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:36.866264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:36.941268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4da8-47f4-47d3-a4db-8905127b89b1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:36.991023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:36.991608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:36.991898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:36.992183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:36.992911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:36.994439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:37.038395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 47/91] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:12:36 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:12:37.039269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:37.093409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec61f2-1547-4f93-9679-0a7121aaf89c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:37.133655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:37.134951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:37.135451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:37.135944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:37.137472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:37.140558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:37.143132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 45/92] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:36 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:37.151743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:37.259175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9509ac-5bcc-431c-95ee-d177bbdaec2c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:37.309615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbc54-31f0-4648-9e7a-57011fb2a123 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:37.324063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:37.330437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:37.330437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:37.330437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:37.330953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:37.332459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:37.334753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 48/93] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:37 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:37.341760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:37.415393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:37.416090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:37.416375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:37.416657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:37.417549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] RBAC: Adding query filter params (role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=51f6a62015a94fde8755dbb4c39831e0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:37.417891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:37.419441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:37.438324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 46/94] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:37 2022] GET /identity/v3/role_assignments?user.id=51f6a62015a94fde8755dbb4c39831e0&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:37.517152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b9c-3384-48c7-9caf-cb35661504a3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:37.571471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:37.572666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:37.573221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:37.573731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:37.667765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:37.669335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:37.777928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 49/95] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:12:37.783996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:37.905815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a05ff-72dc-4e9e-825b-5eac8a055d7c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:37.947608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c859c45-3caa-4b4b-b7ef-85c72e524dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:37.948493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859c45-3caa-4b4b-b7ef-85c72e524dc4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:37.948776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859c45-3caa-4b4b-b7ef-85c72e524dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:37.949059 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859c45-3caa-4b4b-b7ef-85c72e524dc4 None admin] PATH_INFO: `/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:37.950354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c859c45-3caa-4b4b-b7ef-85c72e524dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=89911fc4cc3640fcafc2c3aff0ac1e1a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:37.952379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c859c45-3caa-4b4b-b7ef-85c72e524dc4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:37.954357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 47/96] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:37 2022] GET /identity/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:37.960433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:38.068783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8e56d-174a-4971-bd82-0817a9128a7e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:38.108679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:38.109426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:38.109763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:38.110043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:38.111516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=89911fc4cc3640fcafc2c3aff0ac1e1a, user.id=51f6a62015a94fde8755dbb4c39831e0) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:38.111847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:38.113774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35de16-dc7f-47a7-87df-d1227c9f351e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:38.121454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 50/97] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:37 2022] GET /identity/v3/role_assignments?user.id=51f6a62015a94fde8755dbb4c39831e0&scope.project.id=89911fc4cc3640fcafc2c3aff0ac1e1a&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:38.316910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90a0f-7c71-45da-a7bf-40aaf4e03241 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:38.317432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90a0f-7c71-45da-a7bf-40aaf4e03241 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:38.317903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90a0f-7c71-45da-a7bf-40aaf4e03241 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:38.319498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 48/98] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:38.325333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:38.325649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:38.325979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:38.349154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:38.350411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:38.444502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 51/99] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:38.493053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90a0f-7c71-45da-a7bf-40aaf4e03241 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:38.634756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90a0f-7c71-45da-a7bf-40aaf4e03241 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:38.682519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:38.683749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:38.684256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:38.684731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:38.699060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:38.707546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:38.708454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:38.709207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:38.711640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 49/100] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:38.718965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:38.846789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b06ef-d681-4a53-85bf-bebb77f2114d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:38.891358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:38.891975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:38.892265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:38.892549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:38.893328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:38.893644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:38.895099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:38.905035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 52/101] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:38.910964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:39.175397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb86a-84a3-4368-8f39-9e66a4c7bac0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:39.248792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431141b-1430-4571-acd2-f39474939173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:39.249701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431141b-1430-4571-acd2-f39474939173 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:39.250010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431141b-1430-4571-acd2-f39474939173 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:39.250273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431141b-1430-4571-acd2-f39474939173 None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:39.254631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431141b-1430-4571-acd2-f39474939173 None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:39.256107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431141b-1430-4571-acd2-f39474939173 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:39.258187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 50/102] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:38 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:39.267671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:39.428007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b84399-b322-43f4-8ddf-76876deade89 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:39.489552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189d48b-9cc9-4f2f-9e59-2e4a289419c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:39.490462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d48b-9cc9-4f2f-9e59-2e4a289419c3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:39.490748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d48b-9cc9-4f2f-9e59-2e4a289419c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:39.491030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d48b-9cc9-4f2f-9e59-2e4a289419c3 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:39.492266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189d48b-9cc9-4f2f-9e59-2e4a289419c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:39.493862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189d48b-9cc9-4f2f-9e59-2e4a289419c3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:39.495596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 53/103] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:39 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:39.501599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431141b-1430-4571-acd2-f39474939173 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:39.673469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431141b-1430-4571-acd2-f39474939173 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:39.716056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd515-b34a-4296-875c-56329f242c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:39.717719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd515-b34a-4296-875c-56329f242c53 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:39.718409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd515-b34a-4296-875c-56329f242c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:39.718993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd515-b34a-4296-875c-56329f242c53 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/51f6a62015a94fde8755dbb4c39831e0/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:39.727535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd515-b34a-4296-875c-56329f242c53 None admin] RBAC: Authorizing `identity:create_grant(project_id=e77e4ed0d3164aa192dc64d4affa8503, user_id=51f6a62015a94fde8755dbb4c39831e0, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:39.729308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd515-b34a-4296-875c-56329f242c53 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:39.750122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 51/104] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:39 2022] PUT /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/51f6a62015a94fde8755dbb4c39831e0/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:39.980258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4430af5-cf87-4c24-a399-bbff3e572966 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:39.980762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4430af5-cf87-4c24-a399-bbff3e572966 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:39.980762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4430af5-cf87-4c24-a399-bbff3e572966 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:39.982231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 54/105] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:39.988395 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:39.989487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:39.989979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:40.016197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:40.017678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:40.119070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 52/106] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:40.154488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4430af5-cf87-4c24-a399-bbff3e572966 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:40.293337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4430af5-cf87-4c24-a399-bbff3e572966 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:40.342078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f66d-af3e-457e-98dc-53ccb68f761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:40.343621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f66d-af3e-457e-98dc-53ccb68f761c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:40.343910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f66d-af3e-457e-98dc-53ccb68f761c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:40.344193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f66d-af3e-457e-98dc-53ccb68f761c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:40.358944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335f66d-af3e-457e-98dc-53ccb68f761c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-6335f66d-af3e-457e-98dc-53ccb68f761c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:40.367508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:40.368422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:40.369228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 55/107] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:40.377083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:40.483501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce589-db2b-4781-9f85-95330fe62def None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:40.483854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce589-db2b-4781-9f85-95330fe62def None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:40.484062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce589-db2b-4781-9f85-95330fe62def None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:40.485665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 56/108] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:40.491406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:40.491696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:40.492039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:40.523333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:40.524543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:40.568736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02563-77d3-49df-afb3-0091fe48ecb5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:40.631107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:40.631798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:40.632084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:40.632365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:40.633135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:40.633447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:40.634888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:40.650626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 57/109] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 13 18:12:40.653273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 53/110] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:40.660704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:40.691326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:40.790552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499d765-ad5e-4dbf-b05e-e9560e325aea None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:40.831875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:40.832742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:40.833024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:40.833302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:40.834913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:40.836400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:40.838114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 58/111] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:40 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:40.844954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:40.941079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda128-d154-4edd-8a91-be331d7e3179 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.016705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.017732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.018090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.018375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.046187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:41.061487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:41.062834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:41.063585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 54/112] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:41.069021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:41.118853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f110c-3916-481e-aadd-c48218c266be None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.212117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62137-8825-420d-abe1-8bd7472a5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.213005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62137-8825-420d-abe1-8bd7472a5c74 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.213294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62137-8825-420d-abe1-8bd7472a5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.213578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62137-8825-420d-abe1-8bd7472a5c74 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.214450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5889-6fe7-4b59-afe4-f0f4a3be855d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.218693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62137-8825-420d-abe1-8bd7472a5c74 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:41.220230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62137-8825-420d-abe1-8bd7472a5c74 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:41.222400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 59/113] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:40 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:41.223707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17592fea-927d-4cfd-b59b-2bc29d3e631f None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.224011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17592fea-927d-4cfd-b59b-2bc29d3e631f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.229514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17592fea-927d-4cfd-b59b-2bc29d3e631f None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.229514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 60/114] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:41.235651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.235942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.236233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.268071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:41.269289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:41.271497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.272201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.272492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.272771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.273545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:41.277845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:41.277845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:41.285620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 55/115] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:12:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:41.286505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:41.408738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081a8e-c55d-407f-ae6e-8d6a37d27fe2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.435490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 61/116] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:41.436438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:41.465826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.465826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.465826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.465826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/ec0fceb9f1a04ac58d3b3075178f7b1f/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.467901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e77e4ed0d3164aa192dc64d4affa8503, user_id=ec0fceb9f1a04ac58d3b3075178f7b1f, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:41.469625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:41.500796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 56/117] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:41 2022] PUT /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/ec0fceb9f1a04ac58d3b3075178f7b1f/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:41.501939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:41.591789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b808289-6528-4e1b-bed9-8056af6a6318 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.640031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.640955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.641243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.641522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.643144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:41.647394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:41.649136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 62/118] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:41 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:41.655645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:41.718428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3541-b533-439e-a232-b0a239ba95b5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.787976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820b66-187d-4c96-859f-fb6c0df008c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.788816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820b66-187d-4c96-859f-fb6c0df008c7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.789109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820b66-187d-4c96-859f-fb6c0df008c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.789388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820b66-187d-4c96-859f-fb6c0df008c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.790771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820b66-187d-4c96-859f-fb6c0df008c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:41.792548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820b66-187d-4c96-859f-fb6c0df008c7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:41.795848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 57/119] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:41.797564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6928d-f8b8-4b8a-af81-d98bc2e151ff None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.797877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6928d-f8b8-4b8a-af81-d98bc2e151ff None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.798170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6928d-f8b8-4b8a-af81-d98bc2e151ff None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.804596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 58/120] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:41.805691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6928d-f8b8-4b8a-af81-d98bc2e151ff None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:41.871591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f794-fbc6-4579-9ec8-11c139d476bb None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:41.909213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b6258-c302-444b-bc42-aa0b148b8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:41.910136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6258-c302-444b-bc42-aa0b148b8c78 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.910423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6258-c302-444b-bc42-aa0b148b8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.910703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6258-c302-444b-bc42-aa0b148b8c78 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.912064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b6258-c302-444b-bc42-aa0b148b8c78 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:41.913548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b6258-c302-444b-bc42-aa0b148b8c78 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:41.915720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 63/121] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:41 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:41.917108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c0c9-624e-459a-bee5-18f1e08811a9 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:41.917403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c0c9-624e-459a-bee5-18f1e08811a9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:41.917685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c0c9-624e-459a-bee5-18f1e08811a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:41.941835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8169c0c9-624e-459a-bee5-18f1e08811a9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:41.941835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8169c0c9-624e-459a-bee5-18f1e08811a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:41.976828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6928d-f8b8-4b8a-af81-d98bc2e151ff None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:42.022313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072a67b-d499-4c72-9537-20ee024668b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:42.022966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072a67b-d499-4c72-9537-20ee024668b5 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.023258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072a67b-d499-4c72-9537-20ee024668b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.023539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072a67b-d499-4c72-9537-20ee024668b5 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.023916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 64/122] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:42.025399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238554a1-7243-4efd-94e0-76f4a9f3e39f None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.025696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238554a1-7243-4efd-94e0-76f4a9f3e39f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.026019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238554a1-7243-4efd-94e0-76f4a9f3e39f None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.027392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 65/123] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:42.027794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072a67b-d499-4c72-9537-20ee024668b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:42.028071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238554a1-7243-4efd-94e0-76f4a9f3e39f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.029466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072a67b-d499-4c72-9537-20ee024668b5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:42.076520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 59/124] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:12:41 2022] POST /identity/v3/projects => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:12:42.078926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.079254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.080115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.117483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:42.120672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:42.254690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238554a1-7243-4efd-94e0-76f4a9f3e39f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:42.268995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 60/125] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:42.270188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.329997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:42.331538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.332047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.332551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/51f6a62015a94fde8755dbb4c39831e0/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.339618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e77e4ed0d3164aa192dc64d4affa8503, user_id=51f6a62015a94fde8755dbb4c39831e0, role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:42.341610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:42.372032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 66/126] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:42 2022] PUT /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/51f6a62015a94fde8755dbb4c39831e0/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:42.373003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.518858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5da375-80e8-4dda-a1d6-4aaf9deee7b1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:42.582395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1d89-919e-41c8-88b1-48ccf78130d8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:42.601627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:42.602497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.602783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.603060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.617620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:42.626007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:42.626917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:42.627676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:42.632294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 61/127] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:42.633900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.730371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:42.731817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.732337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.733406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.753098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68a1d-7b52-484c-97b4-063d9d6954bc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:42.761925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:42.784038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:42.784941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:42.785712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:42.787660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 67/128] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:42.792208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:42.792966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.793139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.793290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.793570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.794500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:42.794818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:42.797070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:42.815646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 62/129] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:42.833038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.919837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb4d9-37d6-46ba-bba6-b9f102b7bdc5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:42.955894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:42.956589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:42.956877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:42.957156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:42.957994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:42.958309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:42.959751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:42.973949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 68/130] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:42.975821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:42.981635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5bc3-2ebb-43c4-a7e9-5afbd7d7130d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:43.028045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:43.028950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.029242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.029560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] PATH_INFO: `/v3/users/6f1bde4b0b6b48c5832b6a54ac5306aa` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.058343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] RBAC: Authorizing `identity:get_user(user_id=6f1bde4b0b6b48c5832b6a54ac5306aa)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:43.059856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:43.062596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 63/131] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:42 2022] GET /identity/v3/users/6f1bde4b0b6b48c5832b6a54ac5306aa => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:43.083481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:43.102004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216347b8-8adc-4a97-89f2-c3ad8926e2e3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:43.140386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:43.141364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.141609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.141945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.148288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:43.149817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:43.160780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 69/132] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:42 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:43.164025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:43.252614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225743d-3cf4-46c1-8872-7d5910c17e67 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:43.295336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d231306-f8e7-4a84-b7cd-6efec967f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:43.296190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231306-f8e7-4a84-b7cd-6efec967f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.296478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231306-f8e7-4a84-b7cd-6efec967f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.296767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231306-f8e7-4a84-b7cd-6efec967f6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.371826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b153df5-0d8f-42c8-8b92-9cd9601ad151 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:43.379071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d231306-f8e7-4a84-b7cd-6efec967f6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:43.380665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d231306-f8e7-4a84-b7cd-6efec967f6a7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:43.421149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098dd1d-1888-4e6e-83fd-3ba6c68a6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:43.422198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd1d-1888-4e6e-83fd-3ba6c68a6062 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.422480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd1d-1888-4e6e-83fd-3ba6c68a6062 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.422762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd1d-1888-4e6e-83fd-3ba6c68a6062 None admin] PATH_INFO: `/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.424021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098dd1d-1888-4e6e-83fd-3ba6c68a6062 None admin] RBAC: Authorizing `identity:get_project(project_id=89911fc4cc3640fcafc2c3aff0ac1e1a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:43.425485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098dd1d-1888-4e6e-83fd-3ba6c68a6062 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:43.427454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 70/133] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:43 2022] GET /identity/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:43.433990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aff4e-b51c-4fcf-9b7a-0848929aaf3d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.434286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aff4e-b51c-4fcf-9b7a-0848929aaf3d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.434949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aff4e-b51c-4fcf-9b7a-0848929aaf3d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.436870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 71/134] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:43.437986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aff4e-b51c-4fcf-9b7a-0848929aaf3d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:43.577751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 64/135] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:12:43.579434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.579921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.580414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.598492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aff4e-b51c-4fcf-9b7a-0848929aaf3d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:43.618803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:43.621062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:43.667377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:43.668194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:43.668477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:43.668755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] PATH_INFO: `/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a/users/51f6a62015a94fde8755dbb4c39831e0/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:43.675016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] RBAC: Authorizing `identity:create_grant(project_id=89911fc4cc3640fcafc2c3aff0ac1e1a, user_id=51f6a62015a94fde8755dbb4c39831e0, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:43.678565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:43.711894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 72/136] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:43 2022] PUT /identity/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a/users/51f6a62015a94fde8755dbb4c39831e0/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:12:43.713070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:43.779262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 65/137] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:43.807068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:43.935485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602a5cd-195b-47a8-b65b-4368dca843c4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:43.970959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe4e0c-387c-4c03-8eba-2d59a0344e7b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:44.029725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:44.030654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.030948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.031282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.032523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:44.034139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:44.035900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 73/138] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:43 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:44.036842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:44.038304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.038851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.039348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.042193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:44.066824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:44.075120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:44.076037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:44.077345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:44.084386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 66/139] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:44.090793 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:44.276355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1177ef-72b1-473a-92f8-a1f3fa40a11d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:44.314443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625a52-c059-4d24-bd29-671e6d31f6f6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:44.352026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:44.358041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.358041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.358041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.358041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] RBAC: Adding query filter params (role.id=33c00191e9c646feb4e02795fc905970, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=6f1bde4b0b6b48c5832b6a54ac5306aa) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:44.358041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:44.358041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:44.371403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 74/140] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:44 2022] GET /identity/v3/role_assignments?user.id=6f1bde4b0b6b48c5832b6a54ac5306aa&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=33c00191e9c646feb4e02795fc905970 => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:44.382668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:44.383502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.383789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.384072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.384883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:44.385220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:44.386764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:44.407262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 67/141] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:44.413627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:44.571587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf371a08-c1f5-46f1-909c-b6101e1ec233 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:44.613380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b8000-efaa-4526-89b1-a2fb38135a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:44.614587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b8000-efaa-4526-89b1-a2fb38135a78 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.614876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b8000-efaa-4526-89b1-a2fb38135a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.615160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b8000-efaa-4526-89b1-a2fb38135a78 None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.616441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b8000-efaa-4526-89b1-a2fb38135a78 None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:44.617971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b8000-efaa-4526-89b1-a2fb38135a78 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:44.619671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 75/142] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:44 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:44.625979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:44.737666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669b5b-90d2-4898-bc8c-bda5895c0b53 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:44.774979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:44.775644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.775934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.776222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.851732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:44.853163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:44.933612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd513e54-48d1-4645-a217-27a8925bc20d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.933961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd513e54-48d1-4645-a217-27a8925bc20d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.934207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd513e54-48d1-4645-a217-27a8925bc20d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.936177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 76/143] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:12:44.947568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc651bde-3934-4d14-be09-d6989204361e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:44.947859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc651bde-3934-4d14-be09-d6989204361e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:44.948136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc651bde-3934-4d14-be09-d6989204361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:44.972931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fc651bde-3934-4d14-be09-d6989204361e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:44.974859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fc651bde-3934-4d14-be09-d6989204361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:44.988267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 68/144] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:44.994357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:45.097022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 77/145] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:45.144943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc651bde-3934-4d14-be09-d6989204361e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:45.279993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d44d8-b1a8-45a1-9082-b5e9f8c757bd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:45.300608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc651bde-3934-4d14-be09-d6989204361e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:45.358257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:45.359635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.360162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.360639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.390559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:45.390928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:45.391464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.391736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.392014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.393307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:45.394817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:45.396812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 69/146] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:44 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:45.398959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:45.399790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:45.401080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 78/147] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:12:45.411287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:45.411471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:45.631441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267b9bc-c85c-4055-940b-eb589963e26a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:45.677002 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:45.677612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.677928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.678220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.679110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=51f6a62015a94fde8755dbb4c39831e0) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:45.679436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:45.680951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d0c7-49aa-46c9-b918-fc2dd4694255 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:45.689191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 79/148] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:45 2022] GET /identity/v3/role_assignments?user.id=51f6a62015a94fde8755dbb4c39831e0&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:45.712402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb2de4-c298-4844-97a0-dfb1d6989b1d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:45.766145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59755a3-deb9-42f1-a196-1a93163961bb None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.766911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59755a3-deb9-42f1-a196-1a93163961bb None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.767212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59755a3-deb9-42f1-a196-1a93163961bb None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.769138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 80/149] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:12:45.775744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e678-27ed-425e-82f8-9bf5c171a4e3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.776172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e678-27ed-425e-82f8-9bf5c171a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.776464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e678-27ed-425e-82f8-9bf5c171a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.792882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:45.793583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.793899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.794181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.795534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:45.795850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:45.797467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:45.816548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7d54e678-27ed-425e-82f8-9bf5c171a4e3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:45.817812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7d54e678-27ed-425e-82f8-9bf5c171a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:45.817984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 70/150] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:45.823271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:45.964359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 81/151] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:45.965671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de01dd-374a-42fc-9f39-1432de4651bd None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.965989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de01dd-374a-42fc-9f39-1432de4651bd None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.966271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de01dd-374a-42fc-9f39-1432de4651bd None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:45.972465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 82/152] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:45.975750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:45.976037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:45.976321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.014289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:46.015759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:46.046062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bc550-8342-4a5f-a524-58877d79bbe8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.089663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.090603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.090894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.092341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] PATH_INFO: `/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.094174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] RBAC: Authorizing `identity:get_user(user_id=ec0fceb9f1a04ac58d3b3075178f7b1f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.095873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.098855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 71/153] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:45 2022] GET /identity/v3/users/ec0fceb9f1a04ac58d3b3075178f7b1f => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:46.100378 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.107202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 83/154] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:46.109187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.230728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a26f7-1212-4998-8e3b-e32f7005a9f7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.236586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c402a-7fea-47a9-8eb2-2234a733ae7a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.272273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.272849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.274746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.274746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.290462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.291328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.291618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.291941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.293237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.295007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.296744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 72/155] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:46.298044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.355059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.356893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.403216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e89d-afe9-4533-a49c-555cbd7afabf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.438884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.439805 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.440165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.440820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.452286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:46.460767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:46.461648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 73/156] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:46.468385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.475327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 84/157] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:46.475327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.584345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e2c8-eb33-4feb-8b53-0e5de004ba13 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.612778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd872-e6b8-48c1-8530-6d0f6dce1849 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.620589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.621267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.621549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.621842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.622602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:46.623455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.624877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.633291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 85/158] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:46.638305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.664427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.665456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.665957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.666412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.667328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.669103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.699732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 74/159] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:12:46 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:12:46.708577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.784744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252667e6-a4c7-45d9-a15f-ab40d328c4da None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.833446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ac3d-b7c6-4eef-9ffd-d13c53aec499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.834637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ac3d-b7c6-4eef-9ffd-d13c53aec499 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.834863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ac3d-b7c6-4eef-9ffd-d13c53aec499 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.835125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ac3d-b7c6-4eef-9ffd-d13c53aec499 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.837473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80ac3d-b7c6-4eef-9ffd-d13c53aec499 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.839079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80ac3d-b7c6-4eef-9ffd-d13c53aec499 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.841507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 86/160] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:46.842936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab87edf-6ba9-4fb4-96c3-6d4709edf063 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.843215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab87edf-6ba9-4fb4-96c3-6d4709edf063 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.843489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab87edf-6ba9-4fb4-96c3-6d4709edf063 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.844860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 87/161] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:46.850241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab87edf-6ba9-4fb4-96c3-6d4709edf063 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:46.855630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34932282-4328-447e-9c42-b93ad033a3da None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:46.897362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1961f-6caa-4f86-8327-7636b811c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:46.898658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1961f-6caa-4f86-8327-7636b811c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.899161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1961f-6caa-4f86-8327-7636b811c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.899633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1961f-6caa-4f86-8327-7636b811c7a9 None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.901148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1961f-6caa-4f86-8327-7636b811c7a9 None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:46.903072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1961f-6caa-4f86-8327-7636b811c7a9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:46.906123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 75/162] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:46.907841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:46.908346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:46.908872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:46.927659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:46.929176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:46.993762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab87edf-6ba9-4fb4-96c3-6d4709edf063 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.027613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 76/163] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:47.028472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.049166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.050001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.050284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.050564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.051408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=ec0fceb9f1a04ac58d3b3075178f7b1f) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:47.051717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.053172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:47.059877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 88/164] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:46 2022] GET /identity/v3/role_assignments?user.id=ec0fceb9f1a04ac58d3b3075178f7b1f&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:47.061075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.154703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d7b5-ba0f-44b9-a97f-2186031867ea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.196540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bb62a-eceb-4d50-bad5-ce4ca74857d4 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.202565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.203370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.203652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.203928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.234781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.235672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.235959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.236241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.248615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:47.256937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:47.259530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:47.261065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 89/165] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:47.267097 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.298605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.300135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:47.430315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62b9f-5ac4-47c4-92bc-6bec5840a5e1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.453225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 77/166] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:47.469478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.481861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.482176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.482605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.482896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.483825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:47.484139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.486953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:47.497518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 90/167] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:47.509281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.607091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a87e-929a-449f-b83f-eb16221c9481 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.652463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.653389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.654135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.654978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.657943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.659468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:47.662362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 78/168] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:47.666038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9580e9-8d87-4e80-ada4-ee686735f655 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.668721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.711150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.712022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.712308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.712633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] PATH_INFO: `/v3/users/51f6a62015a94fde8755dbb4c39831e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.714769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] RBAC: Authorizing `identity:get_user(user_id=51f6a62015a94fde8755dbb4c39831e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.716315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:47.719383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 91/169] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/users/51f6a62015a94fde8755dbb4c39831e0 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:47.725206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:47.791838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219a50-8bd8-4e50-8246-8e5bd8c20172 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.830533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.831202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.831483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.831763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.832628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] RBAC: Adding query filter params (role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=51f6a62015a94fde8755dbb4c39831e0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:47.832942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.834468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cec0e-51ec-4698-b416-6a47a62d98a0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:47.840854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 79/170] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/role_assignments?user.id=51f6a62015a94fde8755dbb4c39831e0&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:47.851297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bfb4-bdb2-4a12-b010-465db3062f89 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:47.896976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:47.897650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:47.897970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:47.898250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:47.990603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:47.992041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:48.019904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e434f-4598-457c-964f-7b121e72a956 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.020218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e434f-4598-457c-964f-7b121e72a956 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.020457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e434f-4598-457c-964f-7b121e72a956 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.026291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 80/171] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:48.032380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.032682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.032932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.074909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:48.076809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:48.114692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 92/172] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:48.120308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:48.207543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 81/173] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:48.232844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706628-4820-4534-9e7c-52d79f4f4adf None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:48.234992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:48.272411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:48.273203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.273490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.273767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] PATH_INFO: `/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.278880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=89911fc4cc3640fcafc2c3aff0ac1e1a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:48.282244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:48.284018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 93/174] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:48 2022] GET /identity/v3/projects/89911fc4cc3640fcafc2c3aff0ac1e1a => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:48.291276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:48.421938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2243-376d-41a4-897c-778a85b826f2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:48.493467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc769-ae23-4b66-812c-b6ed9acbe4c8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:48.503478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:48.504620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.505252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.505825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.528953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:48.539223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:48.539887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.540169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.540445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.541302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=89911fc4cc3640fcafc2c3aff0ac1e1a, user.id=51f6a62015a94fde8755dbb4c39831e0) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:48.541618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:48.543095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:48.545141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:48.546023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:48.546816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:48.553613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 94/175] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:48 2022] GET /identity/v3/role_assignments?user.id=51f6a62015a94fde8755dbb4c39831e0&scope.project.id=89911fc4cc3640fcafc2c3aff0ac1e1a&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:48.553988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 82/176] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:12:48.563061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:48.698649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df999eac-d8a2-4df6-a1c6-8368bb9a598e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:48.739754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:48.740453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.740739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.741017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.741817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:48.742139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:48.743576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:48.754296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 95/177] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:48.760190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:48.895990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf538e0-f3a9-4542-91cc-ccb9b68e35cb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:48.930847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:48.932008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:48.932285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:48.932565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] PATH_INFO: `/v3/users/6f1bde4b0b6b48c5832b6a54ac5306aa` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:48.934125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] RBAC: Authorizing `identity:get_user(user_id=6f1bde4b0b6b48c5832b6a54ac5306aa)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:48.936381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:48.938275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 83/178] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:48 2022] GET /identity/v3/users/6f1bde4b0b6b48c5832b6a54ac5306aa => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:48.943528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:49.047538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ebbed-47ae-40b4-8eae-9003fa321f27 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:49.082604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d176-e8cc-40dd-871b-8ef725c65751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:49.083481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d176-e8cc-40dd-871b-8ef725c65751 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:49.083761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d176-e8cc-40dd-871b-8ef725c65751 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:49.084036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d176-e8cc-40dd-871b-8ef725c65751 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:49.085509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82d176-e8cc-40dd-871b-8ef725c65751 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:49.087109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82d176-e8cc-40dd-871b-8ef725c65751 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:49.088961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 96/179] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:48 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:49.095695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:49.209399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9f73f-d19c-4103-a5d6-ba6a08e74992 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:49.256708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a44e5-7743-4282-9f76-acedeca8cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:49.257600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a44e5-7743-4282-9f76-acedeca8cf97 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:49.257922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a44e5-7743-4282-9f76-acedeca8cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:49.258199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a44e5-7743-4282-9f76-acedeca8cf97 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/6f1bde4b0b6b48c5832b6a54ac5306aa/roles/33c00191e9c646feb4e02795fc905970` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:49.262621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a44e5-7743-4282-9f76-acedeca8cf97 None admin] RBAC: Authorizing `identity:create_grant(project_id=e77e4ed0d3164aa192dc64d4affa8503, user_id=6f1bde4b0b6b48c5832b6a54ac5306aa, role_id=33c00191e9c646feb4e02795fc905970)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:49.264711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a44e5-7743-4282-9f76-acedeca8cf97 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:49.283756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 84/180] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:49 2022] PUT /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/users/6f1bde4b0b6b48c5832b6a54ac5306aa/roles/33c00191e9c646feb4e02795fc905970 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:49.938641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e725ca-012a-485c-aef5-ba3b50d3d768 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:49.939200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e725ca-012a-485c-aef5-ba3b50d3d768 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:49.939200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e725ca-012a-485c-aef5-ba3b50d3d768 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:49.940695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 97/181] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:49.948810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:49.950208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:49.951512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:49.974608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:49.976131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:50.045435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 85/182] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:50.069446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e725ca-012a-485c-aef5-ba3b50d3d768 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.191773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e725ca-012a-485c-aef5-ba3b50d3d768 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.228907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea4873-2cbb-46c9-b5c5-8696f8c75932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.229706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea4873-2cbb-46c9-b5c5-8696f8c75932 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.230018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea4873-2cbb-46c9-b5c5-8696f8c75932 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.230292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea4873-2cbb-46c9-b5c5-8696f8c75932 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.242064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea4873-2cbb-46c9-b5c5-8696f8c75932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f2ea4873-2cbb-46c9-b5c5-8696f8c75932 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:50.249878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:50.250791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:50.251588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 98/183] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:50.257071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.354036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8c74-c6c9-4de6-bcb7-cb06386d309b None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.354317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8c74-c6c9-4de6-bcb7-cb06386d309b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.354830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8c74-c6c9-4de6-bcb7-cb06386d309b None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.356635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 99/184] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:50.363402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2bd8-de62-4b10-8e80-b7ce454a7468 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.364069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2bd8-de62-4b10-8e80-b7ce454a7468 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.364562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2bd8-de62-4b10-8e80-b7ce454a7468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.374783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed3ab6-b790-4531-afb6-b7014e17c592 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.382612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0fac2bd8-de62-4b10-8e80-b7ce454a7468 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:50.384121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0fac2bd8-de62-4b10-8e80-b7ce454a7468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:50.409499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.410210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.410493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.410769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.411530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:50.411840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:50.413251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac6f6-6188-41d5-8004-a8a5b487005d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:50.422141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 86/185] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:50.423467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eee35-1b9b-4253-abab-52a6c1daa1eb None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.423758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eee35-1b9b-4253-abab-52a6c1daa1eb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.424037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eee35-1b9b-4253-abab-52a6c1daa1eb None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.425279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 87/186] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:50.427589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eee35-1b9b-4253-abab-52a6c1daa1eb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.473837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 100/187] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:50.479445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.479734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.480020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.499882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:50.501158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:50.549402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eee35-1b9b-4253-abab-52a6c1daa1eb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.572890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 101/188] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:50.573657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.608845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.609723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.610026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.610298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] PATH_INFO: `/v3/users/9dcb6f302fa541c385cbc36f57fb0455` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.624872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] RBAC: Authorizing `identity:get_user(user_id=9dcb6f302fa541c385cbc36f57fb0455)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:50.626370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:50.632732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 88/189] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/users/9dcb6f302fa541c385cbc36f57fb0455 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:50.632732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.706473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c695727-4971-40ed-adb7-59818f90a89e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.736450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b65c3-79ab-420f-bbe1-610aa623faaf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.741065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.741907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.742188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.742456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.753280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:50.761489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:50.762429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:50.763216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 102/190] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:50.764810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.777867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.778681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.778982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.779341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.780703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:50.782199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:50.788383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 89/191] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:50.788383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.875570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9a38-8dd6-447c-907d-8f7c36a94fca None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.903212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7f373-b90d-418f-8e1f-5f1dbdbc326a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:50.909366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.910052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.910419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.910713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.938303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:50.938969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:50.939252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:50.939519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:50.940272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:50.940577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:50.942126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:50.950737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 90/192] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:50.952099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:50.982766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:50.984340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.051995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d4c2-b384-442c-8045-00b8cc78f02d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:51.085032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 103/193] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:51.086230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:51.090140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:51.090865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.091179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.092098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.092921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:51.094429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.115180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 91/194] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:12:50 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:12:51.116253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:51.240297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e542f6-6b3e-4e18-9a3b-e0a5783742bd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:51.278774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:51.280080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.280369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.280700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] PATH_INFO: `/v3/users/9dcb6f302fa541c385cbc36f57fb0455` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.282037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcb6f302fa541c385cbc36f57fb0455)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:51.283519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.285521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 104/195] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/users/9dcb6f302fa541c385cbc36f57fb0455 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:51.295381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:51.298728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f35b5-398f-4bc1-8774-5630f031cfbd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:51.356003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:51.356957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.358794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.358794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.361107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:51.364399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.366818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 92/196] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:51.373987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:51.444288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0221dd-ff72-4dfb-bf6a-d699a5564512 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:51.503459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eae33-fbef-4ac8-997a-da69d48700d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:51.504328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eae33-fbef-4ac8-997a-da69d48700d1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.504671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eae33-fbef-4ac8-997a-da69d48700d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.504895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eae33-fbef-4ac8-997a-da69d48700d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.523372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075773b-7fde-4439-a1d4-46ef53f033d0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:51.580426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:51.581428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.581714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.582023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.582902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=9dcb6f302fa541c385cbc36f57fb0455) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:51.583213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:51.584662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.592514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 93/197] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/role_assignments?user.id=9dcb6f302fa541c385cbc36f57fb0455&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:51.601671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eae33-fbef-4ac8-997a-da69d48700d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:51.603217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eae33-fbef-4ac8-997a-da69d48700d1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.722898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 105/198] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:51.728491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:51.737103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329e82-b512-459a-a5b3-7062ffa3a4d2 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.737376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329e82-b512-459a-a5b3-7062ffa3a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.737651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329e82-b512-459a-a5b3-7062ffa3a4d2 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.739581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 106/199] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:51.745496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.746133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.746641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.769247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:51.770472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:51.886007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 107/200] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:51.896716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab110d0-5bbe-40b8-b2b6-87075b96a1c5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:51.913772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:51.953118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:51.954038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:51.954323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:51.954602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:51.956506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:51.957998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:51.959889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 94/201] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:51.971096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:52.108258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2d1d-fc3a-413c-b067-5a1771d0d696 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:52.116686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee17a7-0f5f-4f7b-9953-f898be0bceaa None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:52.152389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:52.153054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:52.153338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:52.153617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:52.155720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] RBAC: Adding query filter params (role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=9dcb6f302fa541c385cbc36f57fb0455) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:52.156040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:52.157517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:52.163724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 95/202] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/role_assignments?user.id=9dcb6f302fa541c385cbc36f57fb0455&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:52.163962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:52.164883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:52.165165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:52.165434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:52.177753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:52.186738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:52.187690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:52.188489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 108/203] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:52.195415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:52.309047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39e25-6518-4e5b-a136-58d0964802fa None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:52.352418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:52.353439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:52.353925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:52.354379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:52.355322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:52.355824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:52.358644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:52.374555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 96/204] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:52.375938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:52.517125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b602ab-64b8-4bd0-999a-f0f46683301a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:52.552179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:52.553351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:52.553831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:52.554281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] PATH_INFO: `/v3/users/6f1bde4b0b6b48c5832b6a54ac5306aa` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:52.555690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] RBAC: Authorizing `identity:get_user(user_id=6f1bde4b0b6b48c5832b6a54ac5306aa)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:52.557359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:52.559225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 109/205] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:52 2022] GET /identity/v3/users/6f1bde4b0b6b48c5832b6a54ac5306aa => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:52.565582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:52.713654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b33fc-1ffd-43b8-8b3a-2befa7466df2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:52.759807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:52.760461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:52.760795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:52.761072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:52.842229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:52.843744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:52.976698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 97/206] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:52.983049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:53.103079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3af1c-2511-45ad-a1d6-0f2b385d4d36 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:53.137754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b5f2-252a-4755-9a40-6bc650693f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:53.143205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b5f2-252a-4755-9a40-6bc650693f4a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:53.143205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b5f2-252a-4755-9a40-6bc650693f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:53.143205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b5f2-252a-4755-9a40-6bc650693f4a None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:53.143205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b5f2-252a-4755-9a40-6bc650693f4a None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:53.143205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b5f2-252a-4755-9a40-6bc650693f4a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:53.144393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 110/207] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:52 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:53.149554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:53.285960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20b190-5dcd-4673-8e96-eb245291fc64 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:53.320764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:53.321436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:53.321722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:53.322029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:53.322878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] RBAC: Adding query filter params (role.id=33c00191e9c646feb4e02795fc905970, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503, user.id=6f1bde4b0b6b48c5832b6a54ac5306aa) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:53.323193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:53.324757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940295cc-4a5c-475a-ae55-85036faac449 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:53.331357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 98/208] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:53 2022] GET /identity/v3/role_assignments?user.id=6f1bde4b0b6b48c5832b6a54ac5306aa&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=33c00191e9c646feb4e02795fc905970 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:54.066456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05dc96-2b0c-4a44-bddd-da0969386ef4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.066802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05dc96-2b0c-4a44-bddd-da0969386ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.067029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05dc96-2b0c-4a44-bddd-da0969386ef4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.068623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 111/209] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:54.076491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b07e5-5006-47cd-815b-8a0e17d868ed None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.077449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b07e5-5006-47cd-815b-8a0e17d868ed None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.077745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b07e5-5006-47cd-815b-8a0e17d868ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.095811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c04b07e5-5006-47cd-815b-8a0e17d868ed None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:54.097008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c04b07e5-5006-47cd-815b-8a0e17d868ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:54.168111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 99/210] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:54.194518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05dc96-2b0c-4a44-bddd-da0969386ef4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.243985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2a53d-0f85-42ff-8142-ee8bfb33630a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.244291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2a53d-0f85-42ff-8142-ee8bfb33630a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.244546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2a53d-0f85-42ff-8142-ee8bfb33630a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.246110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 100/211] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:12:54.251624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.251909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.252192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.269207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:54.270464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:54.307698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05dc96-2b0c-4a44-bddd-da0969386ef4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:54.338408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 101/212] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:54.345243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:54.346084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.346368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.346641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.347828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:54.349278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:54.351085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 112/213] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:54.356608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.364341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.457895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bef935-f9ba-441c-bdb8-e04a68f3e23b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:54.467909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec031d4-66c6-4b7d-baf3-2bc8a58fba9d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:54.496144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3b7b1-ab72-42f7-af61-740e7d2fb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:54.496819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3b7b1-ab72-42f7-af61-740e7d2fb87a None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.497098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3b7b1-ab72-42f7-af61-740e7d2fb87a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.497370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3b7b1-ab72-42f7-af61-740e7d2fb87a None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.498803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3b7b1-ab72-42f7-af61-740e7d2fb87a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:54.500249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3b7b1-ab72-42f7-af61-740e7d2fb87a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:54.503375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:54.504181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.504463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.504742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.517035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:54.520840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 102/214] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:12:54 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:12:54.522045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d1f77-20e5-4440-b8a6-f5d042e9523e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.522336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d1f77-20e5-4440-b8a6-f5d042e9523e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.522831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d1f77-20e5-4440-b8a6-f5d042e9523e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.523986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 103/215] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:54.529462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.529773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.530044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:54.532942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:54.534047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:54.534869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:54.539495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 113/216] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:12:54.552418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.553837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:54.555028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:54.633104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 104/217] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:54.657155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.695059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb9899-9d9b-4dcf-8165-ef76a6969147 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:54.741233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:54.741435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.741683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.741882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.743137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:54.743137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:54.746398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:54.753877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 114/218] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:54.759700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.783756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ab68-0180-4a54-92e4-a9a270b70ecc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:54.831236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:54.831236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.831520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.831676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.846593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:54.854696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:54.855598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:54.856386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 105/219] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:54.862759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.885874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6e21-958c-48f2-840f-f333694e7f7f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:54.928678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687c0e-b9a0-452d-a844-5412731b28d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:54.929178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687c0e-b9a0-452d-a844-5412731b28d3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.929464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687c0e-b9a0-452d-a844-5412731b28d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.929744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687c0e-b9a0-452d-a844-5412731b28d3 None admin] PATH_INFO: `/v3/users/952fd6816ca94ace86401a2a56fc5c28` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.945458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23687c0e-b9a0-452d-a844-5412731b28d3 None admin] RBAC: Authorizing `identity:get_user(user_id=952fd6816ca94ace86401a2a56fc5c28)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:54.946972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23687c0e-b9a0-452d-a844-5412731b28d3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:54.949009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 115/220] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/users/952fd6816ca94ace86401a2a56fc5c28 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:54.953820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abec78-52df-4613-9113-8152a3d94ce4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:54.953820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abec78-52df-4613-9113-8152a3d94ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:54.953820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abec78-52df-4613-9113-8152a3d94ce4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:54.953820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 116/221] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:54.957345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abec78-52df-4613-9113-8152a3d94ce4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:54.999297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94abcf-61d3-46bc-8f08-7d7c91de1c04 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.042157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.043432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.044038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.045042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.046438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:55.046945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.048948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228ed0a-5df8-421b-8f74-b832a5793410 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.064616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 106/222] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:55.064616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.064616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.064616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.066670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abec78-52df-4613-9113-8152a3d94ce4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.090846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:55.093402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:55.104483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.105375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.105485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.105739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.163316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 107/223] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:55.164538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.180089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.181564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.266521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed960d-e99a-474b-a5fc-09663ee6078c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.285531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 117/224] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:55.290196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.307667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.308889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.309364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.309854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] PATH_INFO: `/v3/users/9dcb6f302fa541c385cbc36f57fb0455` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.312178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] RBAC: Authorizing `identity:get_user(user_id=9dcb6f302fa541c385cbc36f57fb0455)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.313867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.315735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 108/225] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/users/9dcb6f302fa541c385cbc36f57fb0455 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:55.320994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.388078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbbfc3-52e3-4dd7-810d-0b4cf4fe9d84 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.422465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062d13-b289-46cf-a406-2aed3735fcac None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.423865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.424679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.424959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.425232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.436100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:55.444241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:55.445125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:55.445929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 118/226] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:55.446663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.465532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.467321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.467948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.468422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.469940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.471623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.476024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 109/227] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:55.481126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.573185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d869c0-0294-40fb-83c3-5fa85a57d70f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.596080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de80fd-049f-4a7e-8c8f-d3d58b6891d7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.610477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.611489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.611771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.612051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.613334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.615111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.616914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 119/228] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:55.621751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.647838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.649088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.649952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.650728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.651856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:55.652676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.654591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.670349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 110/229] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:55.672990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.723235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a31cb-ee37-4c01-8a23-2f4926b85371 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.774513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad0560-9888-4354-8497-c66455de590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.778212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad0560-9888-4354-8497-c66455de590c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.778326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad0560-9888-4354-8497-c66455de590c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.780231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad0560-9888-4354-8497-c66455de590c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.781084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad0560-9888-4354-8497-c66455de590c None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=952fd6816ca94ace86401a2a56fc5c28) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:55.781399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad0560-9888-4354-8497-c66455de590c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.782901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad0560-9888-4354-8497-c66455de590c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.793912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 120/230] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/role_assignments?user.id=952fd6816ca94ace86401a2a56fc5c28&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:55.793912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad0560-9888-4354-8497-c66455de590c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:55.828619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13858524-c323-411b-954b-22a5b7350bf3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:55.902702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:55.903919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:55.904346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:55.904786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/9dcb6f302fa541c385cbc36f57fb0455/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:55.908662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d9242e9cb643889e745d0f280085cd, user_id=9dcb6f302fa541c385cbc36f57fb0455, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:55.911093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:55.933926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 111/231] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:55 2022] PUT /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/9dcb6f302fa541c385cbc36f57fb0455/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:55.978448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad0560-9888-4354-8497-c66455de590c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:56.036582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:56.037476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:56.037755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:56.038056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] PATH_INFO: `/v3/users/9dcb6f302fa541c385cbc36f57fb0455` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:56.039308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] RBAC: Authorizing `identity:get_user(user_id=9dcb6f302fa541c385cbc36f57fb0455)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:56.040792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:56.042709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 121/232] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:55 2022] GET /identity/v3/users/9dcb6f302fa541c385cbc36f57fb0455 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:56.052825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:56.167606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113351-cf79-46c8-a1f4-011cc38b8b76 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:56.205508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4206057-a963-42f5-8a4c-a5587c6d209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:56.206315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206057-a963-42f5-8a4c-a5587c6d209e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:56.206593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206057-a963-42f5-8a4c-a5587c6d209e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:56.206863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206057-a963-42f5-8a4c-a5587c6d209e None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:56.208068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4206057-a963-42f5-8a4c-a5587c6d209e None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:56.209523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4206057-a963-42f5-8a4c-a5587c6d209e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:56.211262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 112/233] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:56 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:56.217526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:56.332021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca4f1-318d-45f3-8596-8d546feaecaa None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:56.375291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca5726-2b15-4dd6-8dd5-4ee850a284ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:56.376186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5726-2b15-4dd6-8dd5-4ee850a284ef None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:56.376463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5726-2b15-4dd6-8dd5-4ee850a284ef None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:56.376734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5726-2b15-4dd6-8dd5-4ee850a284ef None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/9dcb6f302fa541c385cbc36f57fb0455/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:56.383075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5726-2b15-4dd6-8dd5-4ee850a284ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d9242e9cb643889e745d0f280085cd, user_id=9dcb6f302fa541c385cbc36f57fb0455, role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:56.384525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5726-2b15-4dd6-8dd5-4ee850a284ef None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:56.407283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 122/234] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:56 2022] PUT /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/9dcb6f302fa541c385cbc36f57fb0455/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:12:57.169351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d467-4cfe-4101-ab79-82b55999775f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.170945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d467-4cfe-4101-ab79-82b55999775f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.171421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d467-4cfe-4101-ab79-82b55999775f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.173232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 113/235] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:57.178800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61f61c-a323-4f45-ba8f-b187235bb69b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.179373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61f61c-a323-4f45-ba8f-b187235bb69b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.179846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61f61c-a323-4f45-ba8f-b187235bb69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.208610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7b61f61c-a323-4f45-ba8f-b187235bb69b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:57.210175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7b61f61c-a323-4f45-ba8f-b187235bb69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:57.310719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 123/236] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:57.324675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca859c9-f79e-4895-81fa-6e1e42d9dab9 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.325298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca859c9-f79e-4895-81fa-6e1e42d9dab9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.326467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca859c9-f79e-4895-81fa-6e1e42d9dab9 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.328565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 114/237] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:57.334076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.335025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.335526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.358060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:57.358835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca859c9-f79e-4895-81fa-6e1e42d9dab9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:57.359771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:57.461833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 124/238] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:57.500285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:57.506542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca859c9-f79e-4895-81fa-6e1e42d9dab9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:57.588440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:57.589244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.589526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.589818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.614331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:57.622063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:57.623533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:57.624298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 115/239] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:57.634085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:57.639372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffccb1-5153-4440-8235-20c8b89784d9 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:57.704584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:57.705443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.705732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.706041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.707220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:57.708677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:57.711126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 125/240] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:57.728681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:57.783827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6f57-d639-4cf5-bfcc-869a8e78031d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:57.829413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:57.830120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.830406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.830678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.831440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:57.831743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:57.833141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:57.854655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 116/241] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:57.860846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:57.894030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fb469-d572-4d71-a576-a41bfc564067 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:57.936987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:57.937674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:57.937982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:57.938259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:57.938982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:57.940442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:57.980331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 126/242] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:12:57 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:12:58.034002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963ef9-4bb6-4f96-9d97-7569b2ea10e6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:58.078048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:58.078943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.079224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.079500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] PATH_INFO: `/v3/users/23ec438328fb4229938c58b1e922829d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.098668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] RBAC: Authorizing `identity:get_user(user_id=23ec438328fb4229938c58b1e922829d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:58.100183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:58.102316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 117/243] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:57 2022] GET /identity/v3/users/23ec438328fb4229938c58b1e922829d => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:58.108958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:58.244034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9146eb0-5104-43b8-ab83-40522766dd0b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:58.291093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173b5a-e783-4499-bbe4-35089bfbf0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:58.292108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173b5a-e783-4499-bbe4-35089bfbf0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.292591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173b5a-e783-4499-bbe4-35089bfbf0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.293054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173b5a-e783-4499-bbe4-35089bfbf0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.366506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef173b5a-e783-4499-bbe4-35089bfbf0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:58.368742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef173b5a-e783-4499-bbe4-35089bfbf0b1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:58.481269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 127/244] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:12:58.487891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:58.621723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4a8b5-1a89-4d66-ac6a-18919d397d21 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:58.634840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e152efa-41d5-4de7-928d-710446e48110 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.635438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e152efa-41d5-4de7-928d-710446e48110 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.635896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e152efa-41d5-4de7-928d-710446e48110 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.642676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 128/245] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:12:58.657862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8f208-73d2-45f1-9bed-049a395f71c2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.658606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8f208-73d2-45f1-9bed-049a395f71c2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.659127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8f208-73d2-45f1-9bed-049a395f71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.665428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:58.666333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.666616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.666891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.668892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:58.671140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:58.673180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 118/246] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:58 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:58.679149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:58.684002 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fdb8f208-73d2-45f1-9bed-049a395f71c2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:58.686144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fdb8f208-73d2-45f1-9bed-049a395f71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:58.786553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 129/247] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:12:58.787726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27024c44-eaf2-4dc2-8262-dfd0872679e0 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.788012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27024c44-eaf2-4dc2-8262-dfd0872679e0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.788286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27024c44-eaf2-4dc2-8262-dfd0872679e0 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.789628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 130/248] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:12:58.796690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.797254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.797731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.809438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543d3a-cc57-4853-8a3d-444983c8a83c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:58.815770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:12:58.817258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:12:58.846425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:58.847393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:58.847836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:58.848264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:58.849262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] RBAC: Adding query filter params (role.id=33c00191e9c646feb4e02795fc905970, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=23ec438328fb4229938c58b1e922829d) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:58.849769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:58.852128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:58.859353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 119/249] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:12:58 2022] GET /identity/v3/role_assignments?user.id=23ec438328fb4229938c58b1e922829d&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=33c00191e9c646feb4e02795fc905970 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:58.860465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:58.908321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 131/250] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:12:58.940125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:58.967954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e81d-4860-47b4-b293-7b30b56cae19 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.010402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.011605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.012086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.012543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.024571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:59.032981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:59.033966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:12:59.034761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:12:59.037568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 120/251] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:12:59.043208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:59.086010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3aeb2-fc14-44e6-91ed-a70f03e708f5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.117911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.118783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.119400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.119400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.131798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:12:59.140450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:12:59.141369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:12:59.142192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 132/252] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:12:59.147791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:59.180173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b643c-23ab-46fe-952c-c807fa4fa1be None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.218695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.219770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.220274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.220751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.221918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:59.222461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:59.224071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:59.234363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 121/253] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:59.262955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:59.304843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb14a10-bba6-4425-bded-fa551aa1d32d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.351561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.357562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.358383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.359044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.361651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:12:59.363912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:59.366410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:59.379719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 133/254] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:59.385989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:59.503837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fdc0f-016a-4529-93ca-6cabde1d8100 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.583349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.584616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.585092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.585560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] PATH_INFO: `/v3/users/952fd6816ca94ace86401a2a56fc5c28` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.588508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] RBAC: Authorizing `identity:get_user(user_id=952fd6816ca94ace86401a2a56fc5c28)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:59.592722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:59.594747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 122/255] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:59 2022] GET /identity/v3/users/952fd6816ca94ace86401a2a56fc5c28 => generated 297 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:59.603241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9561-4335-4bf6-9659-2e7e5ab32cae None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.607796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:59.682127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.683381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.683856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.684322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] PATH_INFO: `/v3/users/9dcb6f302fa541c385cbc36f57fb0455` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.688647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] RBAC: Authorizing `identity:get_user(user_id=9dcb6f302fa541c385cbc36f57fb0455)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:59.692571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:59.705340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 134/256] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:12:59 2022] GET /identity/v3/users/9dcb6f302fa541c385cbc36f57fb0455 => generated 283 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:12:59.720441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:12:59.855788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd74eb-f5e2-4955-ae78-f847baf8cfa9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.934251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:12:59.936994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:12:59.938525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:12:59.939681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:12:59.942547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431a60c-f349-4b8c-ad07-50381f4b473d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:12:59.943426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:12:59.945114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:12:59.951862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 123/257] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:12:59 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:12:59.955757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:00.018996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62483089-c593-4882-9de4-dd3f7d23ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:00.021342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62483089-c593-4882-9de4-dd3f7d23ef77 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.021873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62483089-c593-4882-9de4-dd3f7d23ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.023259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62483089-c593-4882-9de4-dd3f7d23ef77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.148804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62483089-c593-4882-9de4-dd3f7d23ef77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:00.150833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62483089-c593-4882-9de4-dd3f7d23ef77 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:00.168840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4bc1d-46a8-4a39-812c-87553670f134 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:00.261165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44ff4-66b6-4ec6-905b-cf2b32544914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:00.262442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44ff4-66b6-4ec6-905b-cf2b32544914 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.263557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44ff4-66b6-4ec6-905b-cf2b32544914 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.264036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44ff4-66b6-4ec6-905b-cf2b32544914 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/952fd6816ca94ace86401a2a56fc5c28/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.268274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44ff4-66b6-4ec6-905b-cf2b32544914 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d9242e9cb643889e745d0f280085cd, user_id=952fd6816ca94ace86401a2a56fc5c28, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:00.270072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44ff4-66b6-4ec6-905b-cf2b32544914 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:00.280155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 135/258] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:13:00.286270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf080f-7bd9-48ac-b93d-9ddd15204d46 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.286874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf080f-7bd9-48ac-b93d-9ddd15204d46 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.287467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf080f-7bd9-48ac-b93d-9ddd15204d46 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.289090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 136/259] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:00.293225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf080f-7bd9-48ac-b93d-9ddd15204d46 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:00.299508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 124/260] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:12:59 2022] PUT /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/952fd6816ca94ace86401a2a56fc5c28/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:00.301169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.301656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.302281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.340341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:00.343261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:00.471170 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf080f-7bd9-48ac-b93d-9ddd15204d46 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:00.472333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 125/261] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:00.509270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:00.556366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:00.557492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.557973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.558419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.560457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:00.562469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:00.564554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 137/262] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:00 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:00.574861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:00.697639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942bd9-a5b6-4372-8ba4-c70e2f0df0d7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:00.734431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:00.735246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.735525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.735802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.746595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:00.755493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:00.756624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:00.757545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 126/263] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:00.762311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:00.801538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24edca8-224c-4c11-b3a1-662d42f45207 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:00.867087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8136-cd20-4bdf-8d02-bd09dc7e2cf6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:00.877182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:00.878101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.878554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.878973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.879957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=9dcb6f302fa541c385cbc36f57fb0455) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:00.880415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:00.882056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:00.900199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 138/264] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:00 2022] GET /identity/v3/role_assignments?user.id=9dcb6f302fa541c385cbc36f57fb0455&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:00.907684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:00.908387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:00.908668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:00.908947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:00.909718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:00.910057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:00.911496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:00.929875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 127/265] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:00.938152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:01.130112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbebb3-00fe-409a-88f6-4ab3734d7374 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:01.186562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:01.187465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:01.187750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:01.188023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] PATH_INFO: `/v3/users/9dcb6f302fa541c385cbc36f57fb0455` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:01.194709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcb6f302fa541c385cbc36f57fb0455)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:01.196236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:01.198355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 139/266] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:00 2022] GET /identity/v3/users/9dcb6f302fa541c385cbc36f57fb0455 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:01.205269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:01.364271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f5f22-bb7c-4f47-8dd1-6c44f650c668 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:01.411091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:01.411736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:01.412026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:01.412360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:01.485476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:01.486999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:01.595870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 128/267] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:01.608110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:01.745911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe79f-5766-4b2c-a4ff-091e58a83135 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:01.789655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5099c-8a17-4308-8d1c-cc0f76546271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:01.790594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5099c-8a17-4308-8d1c-cc0f76546271 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:01.790881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5099c-8a17-4308-8d1c-cc0f76546271 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:01.791159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5099c-8a17-4308-8d1c-cc0f76546271 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:01.792457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5099c-8a17-4308-8d1c-cc0f76546271 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:01.794039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5099c-8a17-4308-8d1c-cc0f76546271 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:01.797202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 140/268] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:01 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:01.804027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:01.959708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab784-5306-4caa-b2a7-fd0677c8e64f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.006484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.007083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.007377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.007658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.008586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] RBAC: Adding query filter params (role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=9dcb6f302fa541c385cbc36f57fb0455) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:02.008911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.010508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc41a90-0dc9-4f4d-88ff-afb7489f7f4e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.026487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 129/269] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:01 2022] GET /identity/v3/role_assignments?user.id=9dcb6f302fa541c385cbc36f57fb0455&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:02.033264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbcdee-03c1-44d1-9aa9-f5dbd0aa744a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.033591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbcdee-03c1-44d1-9aa9-f5dbd0aa744a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.033845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbcdee-03c1-44d1-9aa9-f5dbd0aa744a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.035644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 141/270] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:02.041531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1858d4-5d89-49fa-974f-6f9032c3ea92 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.041860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1858d4-5d89-49fa-974f-6f9032c3ea92 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.042120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1858d4-5d89-49fa-974f-6f9032c3ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.066908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ec1858d4-5d89-49fa-974f-6f9032c3ea92 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:02.068144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ec1858d4-5d89-49fa-974f-6f9032c3ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:02.135391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc08e6-cf23-49ee-b1f7-57efbcf98a35 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.135702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc08e6-cf23-49ee-b1f7-57efbcf98a35 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.135957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc08e6-cf23-49ee-b1f7-57efbcf98a35 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.137919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 142/271] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:02.140348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6223-6172-4eaa-bd65-f0ffd87a1df1 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.140996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6223-6172-4eaa-bd65-f0ffd87a1df1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.141486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6223-6172-4eaa-bd65-f0ffd87a1df1 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.143572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 143/272] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:02.145090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.145752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.146254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.164120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:02.165928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:02.167936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 130/273] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:02.169744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.171057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.171279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.192165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:02.193707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:02.247099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 144/274] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:02.248573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.285861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 131/275] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:02.287194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.387672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d3ffb-141f-4938-ba25-e46074e1a88c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.421144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f78cd-3df0-4a9d-9625-eb50696e90bd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.423969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.424772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.425057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.425701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.437151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:02.445194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:02.446245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:02.447090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 145/276] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:02.447747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.471709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.472541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.472827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.473111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.476764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.478294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.484926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 132/277] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:02.484926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.558076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03efc1-382d-4fcc-a889-99a6cf48a2fc None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.584823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99372819-2556-4859-9f45-c7ea0f8907a3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.592902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.593710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.594135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.594520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.605018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:02.613694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:02.615186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 146/278] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:02.616006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.626792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.627462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.627745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.628023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.628771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:02.629076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.630488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.643553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 133/279] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:02.643553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.715544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2436da-5d3e-410a-a4f5-6b51df585fa7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.744042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96cd94-dafc-4af8-a160-9597f8bd83bb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.750925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.751644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.751927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.752206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.752911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.754393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.781825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 147/280] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:02 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:02.781825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.794963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.795661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.795941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.796274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.797117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:02.797429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.799022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.809307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 134/281] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:02.815936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.891508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37149-f3a0-4b8a-a187-842c14244927 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.928104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a1f40-7326-4c87-9e36-7252f4f5219e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:02.930584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.931581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.931858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.932133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] PATH_INFO: `/v3/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.948826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] RBAC: Authorizing `identity:get_user(user_id=6cd4667f38fe4f668c1a5cb0e4dbbe1b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.950450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.953475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 148/282] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:02.962976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:02.967333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:02.968553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:02.969069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:02.969539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] PATH_INFO: `/v3/users/23ec438328fb4229938c58b1e922829d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:02.971135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] RBAC: Authorizing `identity:get_user(user_id=23ec438328fb4229938c58b1e922829d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:02.972851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:02.975145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 135/283] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/users/23ec438328fb4229938c58b1e922829d => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:02.982185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:03.098847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4fc67-2b31-4b97-a4e6-789270131f6e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:03.123063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7b33-6802-40c2-9f21-62ac31d4e13e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:03.143520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:03.144519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:03.145028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:03.145522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:03.146611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, user.id=6cd4667f38fe4f668c1a5cb0e4dbbe1b, scope.system=all) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:03.147130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:03.148794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:03.156633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 149/284] 10.222.0.84 () {56 vars in 1308 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/role_assignments?user.id=6cd4667f38fe4f668c1a5cb0e4dbbe1b&scope.system=all&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:03.162031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c04c1-ce05-460e-9aae-89e4ce664f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:03.162908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c04c1-ce05-460e-9aae-89e4ce664f47 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:03.163535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c04c1-ce05-460e-9aae-89e4ce664f47 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:03.163535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c04c1-ce05-460e-9aae-89e4ce664f47 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:03.164761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c04c1-ce05-460e-9aae-89e4ce664f47 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:03.166898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c04c1-ce05-460e-9aae-89e4ce664f47 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:03.168377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 136/285] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:02 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:03.174143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:03.297942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beebe1-4757-4003-9263-697851d21c7e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:03.337983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0656b8-89dd-4570-bea4-942f3ad7762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:03.338892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0656b8-89dd-4570-bea4-942f3ad7762b None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:03.339171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0656b8-89dd-4570-bea4-942f3ad7762b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:03.339449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0656b8-89dd-4570-bea4-942f3ad7762b None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/23ec438328fb4229938c58b1e922829d/roles/33c00191e9c646feb4e02795fc905970` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:03.342354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0656b8-89dd-4570-bea4-942f3ad7762b None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d9242e9cb643889e745d0f280085cd, user_id=23ec438328fb4229938c58b1e922829d, role_id=33c00191e9c646feb4e02795fc905970)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:03.343814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0656b8-89dd-4570-bea4-942f3ad7762b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:03.361752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 150/286] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:13:03 2022] PUT /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd/users/23ec438328fb4229938c58b1e922829d/roles/33c00191e9c646feb4e02795fc905970 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:03.503236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacbca2-6484-4e10-8532-f83136360a72 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:03.503587 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacbca2-6484-4e10-8532-f83136360a72 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:03.503797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacbca2-6484-4e10-8532-f83136360a72 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:03.505420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 137/287] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:03.513726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:03.514616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:03.514616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:03.536457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:03.537634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:03.619395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 151/288] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:03.665847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacbca2-6484-4e10-8532-f83136360a72 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:03.785931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacbca2-6484-4e10-8532-f83136360a72 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:03.829721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:03.830557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:03.830842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:03.831115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:03.847535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:03.855420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:03.856285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:03.857588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 138/289] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:03.864789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:03.980801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4e6d-9130-44eb-a97c-4b11d1ddf1ff None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:04.023329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:04.024019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:04.024303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:04.024587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:04.025352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:04.025659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:04.027082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:04.036398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 152/290] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:04.042325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:04.151574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe58b-fd3b-46fe-a29d-5c4bd107be95 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:04.193286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:04.194200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:04.194486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:04.194765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] PATH_INFO: `/v3/users/952fd6816ca94ace86401a2a56fc5c28` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:04.195983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] RBAC: Authorizing `identity:get_user(user_id=952fd6816ca94ace86401a2a56fc5c28)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:04.197430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:04.199417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 139/291] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:04 2022] GET /identity/v3/users/952fd6816ca94ace86401a2a56fc5c28 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:04.205269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:04.346904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecefa5-a756-40f5-bb9f-65d4eb19821c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:04.395793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:04.396826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:04.397303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:04.397770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:04.491326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:04.493104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:04.593281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 153/292] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:04.599351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:04.708217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9527263-e041-4858-9d45-7c48095be132 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:04.754471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ed22c-9d4d-4e6a-9b57-e78765a6f6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:04.755341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ed22c-9d4d-4e6a-9b57-e78765a6f6e2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:04.755622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ed22c-9d4d-4e6a-9b57-e78765a6f6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:04.755900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ed22c-9d4d-4e6a-9b57-e78765a6f6e2 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:04.762512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ed22c-9d4d-4e6a-9b57-e78765a6f6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:04.764520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ed22c-9d4d-4e6a-9b57-e78765a6f6e2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:04.766449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 140/293] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:04 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:04.772404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:04.930133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c52f-cef5-4020-b4c8-88ce37830edd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:04.974017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:04.975063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:04.975546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:04.976018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:04.977053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=952fd6816ca94ace86401a2a56fc5c28) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:04.977567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:04.979216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32892d6-9241-4ea1-a0df-6adbccf6a00b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:04.989349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 154/294] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:04 2022] GET /identity/v3/role_assignments?user.id=952fd6816ca94ace86401a2a56fc5c28&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:05.662293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14f21-6c90-4795-b5e8-9e05e08cdb57 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:05.662637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14f21-6c90-4795-b5e8-9e05e08cdb57 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:05.662985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14f21-6c90-4795-b5e8-9e05e08cdb57 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:05.664378 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 141/295] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:05.670651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af2c17-4d46-4675-bb7c-dbb1f3b79c83 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:05.671250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af2c17-4d46-4675-bb7c-dbb1f3b79c83 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:05.671752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af2c17-4d46-4675-bb7c-dbb1f3b79c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:05.690795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-30af2c17-4d46-4675-bb7c-dbb1f3b79c83 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:05.692393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-30af2c17-4d46-4675-bb7c-dbb1f3b79c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:05.767645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 155/296] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:05.791647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14f21-6c90-4795-b5e8-9e05e08cdb57 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:05.899142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e95b39-3e8a-4d64-badf-cb922f5c4ca6 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:05.900142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e95b39-3e8a-4d64-badf-cb922f5c4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:05.900687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e95b39-3e8a-4d64-badf-cb922f5c4ca6 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:05.901180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14f21-6c90-4795-b5e8-9e05e08cdb57 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:05.904853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 156/297] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:05.909642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:05.910260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:05.910756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:05.930946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:05.932959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:05.939597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:05.940488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:05.940772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:05.941043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:05.957268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:05.967888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:05.968828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:05.969645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:05.971132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 142/298] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:05.976829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.019014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 157/299] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:06.047223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.094265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e75df-2b8e-4bdb-8117-5c7853e55cd1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.127328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.127998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.128281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.128557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.129307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:06.129613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.131089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5e01-4ada-484e-81b7-06f1db3701d1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.144282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 143/300] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:06.144282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847638e-ef7a-4404-a55f-ab7664130ae5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.144282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847638e-ef7a-4404-a55f-ab7664130ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.144282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847638e-ef7a-4404-a55f-ab7664130ae5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.144282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 144/301] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:06.146298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847638e-ef7a-4404-a55f-ab7664130ae5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.155191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb72c5-7091-4ef3-8cd1-c26e316eae63 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.193125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6626526-ec9e-4419-9427-ba535423697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.193956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6626526-ec9e-4419-9427-ba535423697a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.194235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6626526-ec9e-4419-9427-ba535423697a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.194537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6626526-ec9e-4419-9427-ba535423697a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.195667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6626526-ec9e-4419-9427-ba535423697a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.197110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6626526-ec9e-4419-9427-ba535423697a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.204223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 158/302] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:06.204223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.204223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.204223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.217283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:06.218481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:06.258067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847638e-ef7a-4404-a55f-ab7664130ae5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.289645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 159/303] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:06.289645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.301861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.303873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.304366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.304854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] PATH_INFO: `/v3/users/26687b50f7ec4498bdf1c4661af0de38` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.320781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] RBAC: Authorizing `identity:get_user(user_id=26687b50f7ec4498bdf1c4661af0de38)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.322293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.324002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 145/304] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/users/26687b50f7ec4498bdf1c4661af0de38 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:06.324002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.390557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77149fc-e6e6-48ae-a00e-1d22dacc83d7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.420474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ca6f-184f-42db-bc80-bcc2e0f0e7ac None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.422613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.423279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.423557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.423827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] PATH_INFO: `/v3/groups` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.424514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.425975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.440903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 160/305] 10.222.0.84 () {60 vars in 1134 bytes} [Fri May 13 18:13:06 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:06.441725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.456822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9779-7df7-49f1-abe8-4d5cc335e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.460194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9779-7df7-49f1-abe8-4d5cc335e116 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.460194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9779-7df7-49f1-abe8-4d5cc335e116 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.460194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9779-7df7-49f1-abe8-4d5cc335e116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.476527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb9779-7df7-49f1-abe8-4d5cc335e116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f4bb9779-7df7-49f1-abe8-4d5cc335e116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:06.488985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:06.490276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:06.491090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 146/306] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:06.492093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd756b-ee11-40bb-a4f8-4e1725aeffb2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.492093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd756b-ee11-40bb-a4f8-4e1725aeffb2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.492369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd756b-ee11-40bb-a4f8-4e1725aeffb2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.493877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 147/307] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:06.498809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd756b-ee11-40bb-a4f8-4e1725aeffb2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.564064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdb1e0-d50f-4764-97f9-18a91bd74524 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.603262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.603960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.604239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.604511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.605360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] RBAC: Adding query filter params (role.id=33c00191e9c646feb4e02795fc905970, user.id=26687b50f7ec4498bdf1c4661af0de38, scope.system=all) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:06.605726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.607814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf806-fa95-4ddd-849d-8267d8e9e5aa None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.613539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 161/308] 10.222.0.84 () {56 vars in 1308 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/role_assignments?user.id=26687b50f7ec4498bdf1c4661af0de38&scope.system=all&role.id=33c00191e9c646feb4e02795fc905970 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:06.627387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.627669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.627945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.632034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd756b-ee11-40bb-a4f8-4e1725aeffb2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.650346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:06.651157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:06.687693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.688392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.688667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.688936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.690614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:06.690614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.691720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.702879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 148/309] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:06.708395 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.766955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 162/310] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:06.791021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.825226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7392e-75ad-4c7a-a99a-0c7f4fef2930 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.864411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.865290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.865567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.865861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] PATH_INFO: `/v3/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.867150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd4667f38fe4f668c1a5cb0e4dbbe1b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:06.868580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:06.870317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 149/311] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:06.876471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.906483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20108ec0-036a-439e-98c5-e693ce520815 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:06.942083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:06.943327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:06.943817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:06.944328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:06.955759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:06.964056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:06.964954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:06.965840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:06.968551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 163/312] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:06.974432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:06.993422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ba450-4900-4019-88f7-1880a47f8b55 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:07.031246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:07.032472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:07.033012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:07.033488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] PATH_INFO: `/v3/system/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:07.035323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6cd4667f38fe4f668c1a5cb0e4dbbe1b, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:07.036899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:07.049991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 150/313] 10.222.0.84 () {58 vars in 1334 bytes} [Fri May 13 18:13:06 2022] PUT /identity/v3/system/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:13:07.109988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df078-eb1a-4c5c-b8e4-480fd68c0a32 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:07.150341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:07.151434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:07.151927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:07.152445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:07.153500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:07.154044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:07.155698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:07.165787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 164/314] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:07.175026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:07.293621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab07099-1330-49e5-a12d-68643737be26 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:07.328908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:07.329812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:07.330109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:07.330391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] PATH_INFO: `/v3/users/23ec438328fb4229938c58b1e922829d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:07.331644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] RBAC: Authorizing `identity:get_user(user_id=23ec438328fb4229938c58b1e922829d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:07.333108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:07.339525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 151/315] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:07 2022] GET /identity/v3/users/23ec438328fb4229938c58b1e922829d => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:07.341561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:07.446861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914ff2f-1516-4c3c-ae7f-deba860d34e9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:07.486343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:07.487355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:07.487854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:07.488585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:07.560603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:07.562571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:07.668603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 165/316] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:07.674806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:07.780414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77780-18c7-4f6b-8f48-371eefebaf77 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:07.817986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b696fd-14a1-4709-96b5-aff0939c7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:07.819218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b696fd-14a1-4709-96b5-aff0939c7b85 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:07.819696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b696fd-14a1-4709-96b5-aff0939c7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:07.820174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b696fd-14a1-4709-96b5-aff0939c7b85 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:07.821712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b696fd-14a1-4709-96b5-aff0939c7b85 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:07.823383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b696fd-14a1-4709-96b5-aff0939c7b85 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:07.826207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 152/317] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:07 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:07.834931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:07.935595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d5e1-b4e1-464a-9abe-7f848811b441 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:07.971222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:07.971876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:07.972157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:07.972426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:07.973254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] RBAC: Adding query filter params (role.id=33c00191e9c646feb4e02795fc905970, scope.project.id=a5d9242e9cb643889e745d0f280085cd, user.id=23ec438328fb4229938c58b1e922829d) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:07.973560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:07.975016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50dcf-7015-40d5-90fb-5e2c207d18e6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:07.985918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 166/318] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:07 2022] GET /identity/v3/role_assignments?user.id=23ec438328fb4229938c58b1e922829d&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=33c00191e9c646feb4e02795fc905970 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:08.794852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbdab8-fc48-4cde-94a8-5ae8964330a8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:08.795043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbdab8-fc48-4cde-94a8-5ae8964330a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:08.795330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbdab8-fc48-4cde-94a8-5ae8964330a8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:08.796848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 153/319] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:08.802059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd4710-cc0c-417e-9e82-f2f67d3baa7e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:08.802361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd4710-cc0c-417e-9e82-f2f67d3baa7e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:08.802641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd4710-cc0c-417e-9e82-f2f67d3baa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:08.819158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e1fd4710-cc0c-417e-9e82-f2f67d3baa7e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:08.820362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e1fd4710-cc0c-417e-9e82-f2f67d3baa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:08.888285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 167/320] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:08.911079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbdab8-fc48-4cde-94a8-5ae8964330a8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:08.931517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3eb2-89d6-48be-944b-06649af8dfe0 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:08.931845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3eb2-89d6-48be-944b-06649af8dfe0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:08.932084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3eb2-89d6-48be-944b-06649af8dfe0 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:08.933609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 168/321] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:08.938667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:08.939222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:08.939222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:08.955519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:08.956690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:09.016765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbdab8-fc48-4cde-94a8-5ae8964330a8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.024501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 169/322] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:09.047350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.050739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.051525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.051803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.052075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.053415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:09.054955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:09.056755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 154/323] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:09.063076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.144973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e2ab-2a0b-42a5-a545-a1f37a198460 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.164528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de394-1bb5-4f8d-8b23-33b6bafba0dc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.179928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.180979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.181454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.181729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.194800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:09.198332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.198998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.199280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.199554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] PATH_INFO: `/v3/groups` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.200803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:09.202388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:09.207937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:09.209195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:09.210387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 170/324] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:09.217899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.225658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 155/325] 10.222.0.84 () {60 vars in 1134 bytes} [Fri May 13 18:13:09 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:13:09.334887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2c2c-bf42-49fc-9ae7-6f30762f3224 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.371365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.373192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.373624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.374092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.375149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] RBAC: Adding query filter params (name=reader) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:09.375606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:09.377179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3d6b-232a-48f3-9b26-37f635a68caa None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:09.386683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 171/326] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:09.392958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.428595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e581a-f86f-430a-a44e-d9761bd8cfae None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.428911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e581a-f86f-430a-a44e-d9761bd8cfae None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.429159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e581a-f86f-430a-a44e-d9761bd8cfae None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.430727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 172/327] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:09.436923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.437270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.437558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.454220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:09.455421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:09.501394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c71d7d-d539-4d51-ab72-127b022c0eb4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.539645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 173/328] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:09.546030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.546915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.547311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.547470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] PATH_INFO: `/v3/users/26687b50f7ec4498bdf1c4661af0de38` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.549331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=26687b50f7ec4498bdf1c4661af0de38)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:09.550869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:09.552847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 156/329] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:09 2022] GET /identity/v3/users/26687b50f7ec4498bdf1c4661af0de38 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:09.558569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.563657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.673596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103310e-451a-4cb4-acaa-cbf3503fe5ba None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.681429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5cb00-e5f2-40d4-9fa7-52a963268eb9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.709331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.710521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.710521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.710789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] PATH_INFO: `/v3/system/users/26687b50f7ec4498bdf1c4661af0de38/roles/33c00191e9c646feb4e02795fc905970` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.713252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26687b50f7ec4498bdf1c4661af0de38, role_id=33c00191e9c646feb4e02795fc905970)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:09.714670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:09.725853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 174/330] 10.222.0.84 () {58 vars in 1334 bytes} [Fri May 13 18:13:09 2022] PUT /identity/v3/system/users/26687b50f7ec4498bdf1c4661af0de38/roles/33c00191e9c646feb4e02795fc905970 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:09.726551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.727360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.727646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.736420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.750296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:09.758475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:09.759457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:09.760225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 157/331] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:09.767877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:09.890879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b169e-a05e-491a-a2a2-e39bca8e8950 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:09.927542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:09.928400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:09.928689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:09.928970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:09.929949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:09.930306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:09.931814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:09.942323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 175/332] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:09.947965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:10.059224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9f385-26a3-4018-9e11-475c8f1a2c12 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:10.095896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1d670-66ee-4594-bcfc-7d52a0b9a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:10.097133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1d670-66ee-4594-bcfc-7d52a0b9a94c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:10.097720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1d670-66ee-4594-bcfc-7d52a0b9a94c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:10.098230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1d670-66ee-4594-bcfc-7d52a0b9a94c None admin] PATH_INFO: `/v3/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:10.099624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1d670-66ee-4594-bcfc-7d52a0b9a94c None admin] RBAC: Authorizing `identity:get_user(user_id=6cd4667f38fe4f668c1a5cb0e4dbbe1b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:10.101377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1d670-66ee-4594-bcfc-7d52a0b9a94c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:10.103222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 158/333] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:09 2022] GET /identity/v3/users/6cd4667f38fe4f668c1a5cb0e4dbbe1b => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:10.109179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:10.231577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594945-1452-4341-913a-300658b52ab6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:10.271385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:10.272056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:10.272343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:10.272618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:10.273473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] RBAC: Adding query filter params (role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, user.id=6cd4667f38fe4f668c1a5cb0e4dbbe1b, scope.system=all) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:10.273819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:10.275269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb1d5-d3b1-4fce-88fe-c706b8464c68 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:10.288829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 176/334] 10.222.0.84 () {56 vars in 1308 bytes} [Fri May 13 18:13:10 2022] GET /identity/v3/role_assignments?user.id=6cd4667f38fe4f668c1a5cb0e4dbbe1b&scope.system=all&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:12.034221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51d1d-0e6d-450e-9390-dd7782f17d0a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.034975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51d1d-0e6d-450e-9390-dd7782f17d0a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.034975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51d1d-0e6d-450e-9390-dd7782f17d0a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.036470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 159/335] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:12.042738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdc4a-d691-43f1-a4ff-894692a4c2ef None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.043236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdc4a-d691-43f1-a4ff-894692a4c2ef None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.043319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdc4a-d691-43f1-a4ff-894692a4c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.062646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d5cbdc4a-d691-43f1-a4ff-894692a4c2ef None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:12.064202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d5cbdc4a-d691-43f1-a4ff-894692a4c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:12.139441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 177/336] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:12.164692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51d1d-0e6d-450e-9390-dd7782f17d0a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:12.270281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a51d1d-0e6d-450e-9390-dd7782f17d0a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:12.273624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb2da-ad9e-4012-a516-57730c4af1a4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.274167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb2da-ad9e-4012-a516-57730c4af1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.274663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb2da-ad9e-4012-a516-57730c4af1a4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.276227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 178/337] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:12.288536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.289127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.289607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.308918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:12.311435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:12.333624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:12.334733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.334733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.335021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.355259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:12.373379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:12.374404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:12.375232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 160/338] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:12.401820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:12.417064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 179/339] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:12.470702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:12.584721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53994817-065d-4994-956f-19b9b6174d8c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:12.648076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:12.649033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.649829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.650268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.651175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:12.651637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:12.660398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:12.670938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 161/340] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:12.677582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:12.682970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7f9fe-f0d8-4f7d-a373-47022616c429 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:12.755462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:12.756439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.756820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.757191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.787032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:12.797828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:12.798796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:12.799582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:12.802772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 180/341] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:12.807880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:12.839713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57a9f5-abe6-47d1-b951-e0e17e958e4c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:12.890862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:12.891720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:12.892078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:12.892362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:12.991163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:12.993252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.041897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c644c-361b-4508-9f13-067cc2df589a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.079844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.081349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.081888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.082392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.083358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:13.083866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:13.085471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b21f-fd1b-4aa1-bcbd-a5a1d3ddb60f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.095591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 181/342] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:13.099294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190ae62-5f0d-461a-bbff-c01e0a7ee6f9 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.099834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190ae62-5f0d-461a-bbff-c01e0a7ee6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.100316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190ae62-5f0d-461a-bbff-c01e0a7ee6f9 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.102132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 182/343] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:13.103096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190ae62-5f0d-461a-bbff-c01e0a7ee6f9 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.104078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 162/344] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:13:13.109774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.211542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cc370-efd8-4f27-ba3d-d0611f6ac2f2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.216608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190ae62-5f0d-461a-bbff-c01e0a7ee6f9 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.249750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745cfe6-9eda-49c9-8af7-120fe762917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.251037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745cfe6-9eda-49c9-8af7-120fe762917d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.251562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745cfe6-9eda-49c9-8af7-120fe762917d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.251992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745cfe6-9eda-49c9-8af7-120fe762917d None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.252725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eed474-fcdc-4793-9379-a4e609f2bbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.253476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eed474-fcdc-4793-9379-a4e609f2bbc7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.253694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745cfe6-9eda-49c9-8af7-120fe762917d None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:13.253984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eed474-fcdc-4793-9379-a4e609f2bbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.254357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eed474-fcdc-4793-9379-a4e609f2bbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.255791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745cfe6-9eda-49c9-8af7-120fe762917d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.258025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 163/345] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:13.259423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ff63-a075-4a42-b2a3-3e440f613de8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.259889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ff63-a075-4a42-b2a3-3e440f613de8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.260340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ff63-a075-4a42-b2a3-3e440f613de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.282618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-59c5ff63-a075-4a42-b2a3-3e440f613de8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:13.284136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-59c5ff63-a075-4a42-b2a3-3e440f613de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:13.325511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eed474-fcdc-4793-9379-a4e609f2bbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:13.327111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eed474-fcdc-4793-9379-a4e609f2bbc7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.353677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 164/346] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:13.355412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe96bc-c881-4aa2-819e-d1437a36b517 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.355896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe96bc-c881-4aa2-819e-d1437a36b517 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.357034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe96bc-c881-4aa2-819e-d1437a36b517 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.358566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 165/347] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:13.359470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe96bc-c881-4aa2-819e-d1437a36b517 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.431652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 183/348] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:13.432952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.433240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.433518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.450603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:13.451993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:13.467889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe96bc-c881-4aa2-819e-d1437a36b517 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.505092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.506351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.506833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.507315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.514537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:13.516308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.518266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 166/349] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:13.519253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.537752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 184/350] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:13.538728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.632634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41ac6-1ec5-4106-89c2-0eab70d07ee8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.644008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d702-9803-452f-8336-a0b9dd33b2c7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.667842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.669719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.670262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.670769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.679997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.681098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.681526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.682009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.682495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:13.683529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:13.686036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.688242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 185/351] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:13.689180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:13.691448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:13.692389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 18:13:13.693189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:13.695877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 167/352] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:13.696898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.794950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f44a-ec8b-4a15-b7f9-d5f9549f3e90 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.800270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a48ef-72a9-42b6-8e5f-45760fe7cdb5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.831031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.831694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.832208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.832315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.833188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:13.833529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:13.835212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:13.838296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.839397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.839885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.840380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:13.842699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 186/353] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:13.843872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.857466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:13.870044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:13.871012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:13.872522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:13.874989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 168/354] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:13.881826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:13.959967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9fe21-bbfb-4708-9148-43451715f14d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:13.995961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:13.996949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:13.997366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:13.997746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.002057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.002057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.002726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 187/355] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.003533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.026285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba07bc-afce-435e-abc5-84a54442be35 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.098626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.099331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.099624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.099905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.100686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:14.101061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.102604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.117423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463028f-9a34-4b9f-8df6-2db25f35fb4f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.121544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 169/356] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.123132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.156353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.157041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.157323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.157603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.158426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:14.158736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.160132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.169971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 188/357] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.170851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.277251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0cb7-c599-4a6b-93c2-d23d47361846 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.312736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.313617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.313923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.314201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] PATH_INFO: `/v3/users/26687b50f7ec4498bdf1c4661af0de38` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.315424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] RBAC: Authorizing `identity:get_user(user_id=26687b50f7ec4498bdf1c4661af0de38)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.316886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.318598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 189/358] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/users/26687b50f7ec4498bdf1c4661af0de38 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.319371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.333333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626fc7-050e-4fab-9cd1-0b7a9d1c882f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.384022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.385062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.385554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.386098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.387151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:14.387757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.389566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1942e8-831e-450b-8845-81d841458f69 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.397410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 170/359] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.399138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5119-f5d5-413c-846f-171188b3fedd None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.399640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5119-f5d5-413c-846f-171188b3fedd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.400146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5119-f5d5-413c-846f-171188b3fedd None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.401740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 171/360] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:14.402802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5119-f5d5-413c-846f-171188b3fedd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.454658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf37ff-4056-41cd-8786-6077a7878506 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.500372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.501027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.501522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.501986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.540411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5119-f5d5-413c-846f-171188b3fedd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.580956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.582493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.591389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.592447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.592928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.593397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.595136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] RBAC: Adding query filter params (role.id=33c00191e9c646feb4e02795fc905970, user.id=26687b50f7ec4498bdf1c4661af0de38, scope.system=all) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:14.595704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.597787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f635a3-9a7a-4518-81e2-61d7fc9df347 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.615189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 172/361] 10.222.0.84 () {56 vars in 1308 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/role_assignments?user.id=26687b50f7ec4498bdf1c4661af0de38&scope.system=all&role.id=33c00191e9c646feb4e02795fc905970 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.616536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166680-b730-488e-b7dd-912654a0d25e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.616902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166680-b730-488e-b7dd-912654a0d25e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.617186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166680-b730-488e-b7dd-912654a0d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.635825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-13166680-b730-488e-b7dd-912654a0d25e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:14.637067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13166680-b730-488e-b7dd-912654a0d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:14.718197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 190/362] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:14.724067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.752225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 173/363] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:14.796933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166680-b730-488e-b7dd-912654a0d25e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.921194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d586ff-a3fc-4902-9e0b-d4870b36a032 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.942558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166680-b730-488e-b7dd-912654a0d25e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:14.961505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.962611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.962909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.963178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:14.965060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:14.967127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:14.968872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 191/364] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:14.975450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:14.986565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:14.987390 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:14.987674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:14.987945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.010750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:15.022459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:15.023418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:15.024212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 174/365] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:15.030858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.146508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57460c-408b-4386-afdf-5d84a8f62fce None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:15.183140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a3dc1-9cbd-4bfe-9447-894edb0c77b4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:15.192479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368ac41-6fcd-47f8-a7e1-58d10f876b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:15.193400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ac41-6fcd-47f8-a7e1-58d10f876b17 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.193702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ac41-6fcd-47f8-a7e1-58d10f876b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.194010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ac41-6fcd-47f8-a7e1-58d10f876b17 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.195259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368ac41-6fcd-47f8-a7e1-58d10f876b17 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:15.196716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368ac41-6fcd-47f8-a7e1-58d10f876b17 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:15.198795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 192/366] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:14 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:15.200104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5578d8-0c53-48ed-87d5-32804a3cb2be None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.200390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5578d8-0c53-48ed-87d5-32804a3cb2be None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.200668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5578d8-0c53-48ed-87d5-32804a3cb2be None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.202158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 193/367] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:15.204983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5578d8-0c53-48ed-87d5-32804a3cb2be None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.227518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:15.228491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.228777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.229057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.230309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:15.230623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:15.232740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ece1-6591-4b6e-9108-28b9494e381b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:15.247586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 175/368] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:15.249299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.252394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.252539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.273937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:15.275405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:15.343762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5578d8-0c53-48ed-87d5-32804a3cb2be None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:15.365744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 176/369] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:15.366912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.380614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:15.381193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.381475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.381874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.382717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=a5d9242e9cb643889e745d0f280085cd) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:15.383357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:15.389881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:15.391532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 194/370] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:15.412900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.541835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924ee2-cac1-4b70-a061-e5ad075cc5c0 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:15.589219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:15.590065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.590450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.591250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.619658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:15.623685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0b775-9a1e-4016-b657-1eb53383c9ea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:15.628500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:15.629622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:15.630662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 195/371] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:15.636931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.666144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:15.667231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.667810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.668229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.755977 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:15.758129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:15.770922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46313ae-18f1-4b91-8487-23f965e7550c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:15.815115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:15.816075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:15.817139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:15.817590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:15.818884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:15.819378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:15.821827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:15.836716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 196/372] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:15.843415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.920702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 177/373] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:15.926281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:15.966834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2055a1-1918-424f-b151-6df3d2f56e6b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.006377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.007306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.007752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.008338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.084227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.085974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.120178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f2484-8081-47a1-b84c-5f723491efad None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.161660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.162577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.162837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.163106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.164287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.165702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.167732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 178/374] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:16.175115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:16.195406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 197/375] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:16.198637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:16.285119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86e726-7d94-48a0-aaf5-ed2be8a39433 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.312785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23695b-3724-427f-be8b-60a09de27ba2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.324009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.326040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.326556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.327050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.329017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.331089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.333201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 179/376] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:16 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:16.339372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:16.374551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.375709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.376144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.376559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] PATH_INFO: `/v3/projects/a135c41fcf464430b5b4b85603ac96eb` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.379026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] RBAC: Authorizing `identity:get_project(project_id=a135c41fcf464430b5b4b85603ac96eb)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.380631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.384064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 198/377] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:16 2022] GET /identity/v3/projects/a135c41fcf464430b5b4b85603ac96eb => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:16.389735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:16.461082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c662-1773-4b5c-bfa2-ee6090c5461c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.500456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.502121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.502547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.502962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.503943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=a5d9242e9cb643889e745d0f280085cd) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:16.504417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.506064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.512989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 180/378] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:16 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:16.580688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124e950-f166-4c0a-b1d1-e5da79220a6f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.633398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5218-9f73-4b58-b86e-4aa9dac06a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.634313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5218-9f73-4b58-b86e-4aa9dac06a95 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.634596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5218-9f73-4b58-b86e-4aa9dac06a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.634872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5218-9f73-4b58-b86e-4aa9dac06a95 None admin] PATH_INFO: `/v3/groups/67ec9e5967b24daaa2a7514ee020c86f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.643802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5218-9f73-4b58-b86e-4aa9dac06a95 None admin] RBAC: Authorizing `identity:get_group(group_id=67ec9e5967b24daaa2a7514ee020c86f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.645281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5218-9f73-4b58-b86e-4aa9dac06a95 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.647397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 199/379] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:16 2022] GET /identity/v3/groups/67ec9e5967b24daaa2a7514ee020c86f => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:16.653008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:16.798067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faa633-9ec8-4cbd-9389-793fdba2ecc4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:16.837326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:16.838291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:16.838761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:16.839187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:16.840205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] RBAC: Adding query filter params (group.id=67ec9e5967b24daaa2a7514ee020c86f, role.id=86c6955a20734baf912fede27a24309e, scope.project.id=a135c41fcf464430b5b4b85603ac96eb) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:16.840715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:16.842503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec900e6-110f-4d66-bce7-832bc3a30541 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:16.849007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 181/380] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:16 2022] GET /identity/v3/role_assignments?group.id=67ec9e5967b24daaa2a7514ee020c86f&scope.project.id=a135c41fcf464430b5b4b85603ac96eb&role.id=86c6955a20734baf912fede27a24309e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:17.263791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1ac9-a2f8-42b1-b483-ad91daa2220f None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:17.264831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1ac9-a2f8-42b1-b483-ad91daa2220f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:17.265342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1ac9-a2f8-42b1-b483-ad91daa2220f None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:17.267012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 200/381] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:17.273929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:17.274521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:17.275005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:17.297106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:17.299088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:17.384014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 182/382] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:17.427266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1ac9-a2f8-42b1-b483-ad91daa2220f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:17.580431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1ac9-a2f8-42b1-b483-ad91daa2220f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:17.623414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:17.624234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:17.624507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:17.624783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:17.639119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:17.647429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:17.648311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:17.649516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 201/383] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:17.656957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:17.800835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e825c3-b671-4930-8c03-c41d042d39cc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:17.844464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:17.845520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:17.846050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:17.846535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:17.847503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:17.848032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:17.849639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fff3c4-553a-4d24-bb36-27f535fb9de5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:17.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 183/384] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:17.867638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:17.941384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf21d6d-6f0e-4384-8e6e-e47338b69eac None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:17.941384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf21d6d-6f0e-4384-8e6e-e47338b69eac None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:17.941384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf21d6d-6f0e-4384-8e6e-e47338b69eac None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:17.942123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 184/385] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:17.979712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:17.980332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:17.980870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.011024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ca647-5db7-415f-9373-37291be84b1c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.016579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:18.018038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:18.051431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.052308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.052594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.052876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.056939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:18.058439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:18.060980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 202/386] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:17 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:18.067599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.169571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 185/387] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:18.219268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.225843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65adc-7440-4ef3-aa5a-fbd328c3f707 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.266996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.267871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.268156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.268435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.270337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:18.271802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:18.273688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 203/388] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:18.279599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.358448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917906d-1a27-4a84-bd73-af73e32ffbc2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.397668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64de24-5df2-4a5f-a5c7-9913dc2f0a9d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.398163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a1fcc-443b-4d3a-9282-e4f60e7001eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.399177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a1fcc-443b-4d3a-9282-e4f60e7001eb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.399612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a1fcc-443b-4d3a-9282-e4f60e7001eb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.400028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a1fcc-443b-4d3a-9282-e4f60e7001eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.412629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a1fcc-443b-4d3a-9282-e4f60e7001eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cb3a1fcc-443b-4d3a-9282-e4f60e7001eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:18.420971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:18.422076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:18.423032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:18.425234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 186/389] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:18.431001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072eab-8e19-4a61-9516-76f5ab77d5ac None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.431482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072eab-8e19-4a61-9516-76f5ab77d5ac None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.432010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072eab-8e19-4a61-9516-76f5ab77d5ac None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.433487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c3c0-b573-4262-ad80-efbaa11c106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.433831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 187/390] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:18.434703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c3c0-b573-4262-ad80-efbaa11c106d None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.435359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c3c0-b573-4262-ad80-efbaa11c106d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.435534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072eab-8e19-4a61-9516-76f5ab77d5ac None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.435972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c3c0-b573-4262-ad80-efbaa11c106d None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.439436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85c3c0-b573-4262-ad80-efbaa11c106d None admin] RBAC: Authorizing `identity:create_grant(project_id=e77e4ed0d3164aa192dc64d4affa8503, group_id=1852cb1d77264b71a4d04e7ef0605b78, role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:18.441143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85c3c0-b573-4262-ad80-efbaa11c106d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:18.457729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 204/391] 10.222.0.84 () {58 vars in 1442 bytes} [Fri May 13 18:13:18 2022] PUT /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:13:18.459632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.460180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.460713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.515094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:18.516372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:18.572570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072eab-8e19-4a61-9516-76f5ab77d5ac None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.618247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.619929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.620459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.620944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.622598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:18.623166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:18.625422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:18.636873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 188/392] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:18.642787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.684234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 205/393] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:18.707510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.795587 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1993fb-03fd-4d0e-a79c-a904eba6960d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.835318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4436b7-73da-4f82-84f4-edbf234e533b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:18.838857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.842859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.843417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.843906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.845932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:18.848310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:18.851075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 189/394] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:18.856619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:18.894307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:18.895121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:18.895406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:18.896197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:18.908961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:18.918093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:18.919695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:18.920465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:18.922743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 206/395] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:18.928303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:19.016658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee786fd-edc7-49ce-8ea9-14a751f7d5ee None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:19.049837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ec087-bd5e-4da5-bf00-adeac4221de0 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:19.051780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:19.052957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.053485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.054013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.055463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:19.057094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:19.059313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 190/396] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:19.065258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:19.139523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:19.140207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.140492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.140769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.141537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:19.141870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:19.143278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:19.164424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 207/397] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:19.171047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:19.190695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef534d-3e20-4719-b1bf-1eb615c82581 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:19.230466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:19.232099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.232590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.233117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.236046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] RBAC: Authorizing `identity:create_grant(project_id=e77e4ed0d3164aa192dc64d4affa8503, group_id=1852cb1d77264b71a4d04e7ef0605b78, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:19.237762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:19.255879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 191/398] 10.222.0.84 () {58 vars in 1442 bytes} [Fri May 13 18:13:19 2022] PUT /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:13:19.336546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62d39-b7a1-41b0-a503-e4826a57f193 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:19.380969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:19.382333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.382884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.383361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.385058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:19.387022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:19.390575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 208/399] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:19 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:19.395944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:19.511024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992b2f-eec1-499c-9c13-da979dd46241 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:19.548787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f8a23-a383-4245-90ac-a12d08db16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:19.549672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f8a23-a383-4245-90ac-a12d08db16cc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.549991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f8a23-a383-4245-90ac-a12d08db16cc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.550270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f8a23-a383-4245-90ac-a12d08db16cc None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.551576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f8a23-a383-4245-90ac-a12d08db16cc None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:19.553118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f8a23-a383-4245-90ac-a12d08db16cc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:19.555296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 192/400] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:19 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:19.562132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:19.676696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a8f7-8a31-4389-a805-e9ef1af1b3b6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:19.712783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5df58-41fa-4661-9d0c-ab717bc40c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:19.713742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5df58-41fa-4661-9d0c-ab717bc40c8d None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.714060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5df58-41fa-4661-9d0c-ab717bc40c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.714340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5df58-41fa-4661-9d0c-ab717bc40c8d None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.717178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5df58-41fa-4661-9d0c-ab717bc40c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d9242e9cb643889e745d0f280085cd, group_id=1852cb1d77264b71a4d04e7ef0605b78, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:19.718728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5df58-41fa-4661-9d0c-ab717bc40c8d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:19.740661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 209/401] 10.222.0.84 () {58 vars in 1442 bytes} [Fri May 13 18:13:19 2022] PUT /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:19.827117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ec93-2049-40e4-9f11-56aa939c96f1 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.827511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ec93-2049-40e4-9f11-56aa939c96f1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.827799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ec93-2049-40e4-9f11-56aa939c96f1 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.829605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 193/402] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:19.835156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493f3f-b053-4042-9475-28290681a081 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.835452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493f3f-b053-4042-9475-28290681a081 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.835742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493f3f-b053-4042-9475-28290681a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.860568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c5493f3f-b053-4042-9475-28290681a081 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:19.861785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c5493f3f-b053-4042-9475-28290681a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:19.895279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45016be1-393b-4a0c-b7d2-b6a5d9898c91 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.895655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45016be1-393b-4a0c-b7d2-b6a5d9898c91 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.895853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45016be1-393b-4a0c-b7d2-b6a5d9898c91 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.897505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 194/403] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:13:19.903966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:19.904276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:19.904530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:19.936611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:19.941052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:19.984171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 210/404] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:20.023627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493f3f-b053-4042-9475-28290681a081 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.023949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 195/405] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:20.060922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.146480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493f3f-b053-4042-9475-28290681a081 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.194267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.195000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.195282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.195555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.219566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:20.226971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ee80-2a97-413f-b42c-c37c1cfc5c07 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:20.227487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:20.228343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:20.229119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 211/406] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:20.235507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.302105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.302974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.303263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.303536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.331169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:20.347895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:20.348861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:20.349625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:20.350717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400ad7a-26b7-430e-a418-c1486025181d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.352818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 196/407] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:20.359334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.389383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.390096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.390382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.390659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.391423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:20.391732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:20.393117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:20.403844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 212/408] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:20.408494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.527117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb0f4-5330-4433-8176-c9fab443093a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.533303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf30fa5-c90d-4e02-87de-fd1457ee8c7b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.565518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.566511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.566948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.567350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.568225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:20.568666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:20.570195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:20.572804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.573710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.574120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.575033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] PATH_INFO: `/v3/groups/67ec9e5967b24daaa2a7514ee020c86f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.577224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] RBAC: Authorizing `identity:get_group(group_id=67ec9e5967b24daaa2a7514ee020c86f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:20.578645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:20.580759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 197/410] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:20.584312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 213/410] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/groups/67ec9e5967b24daaa2a7514ee020c86f => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:20.586857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.587095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.713243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb4b2f-7759-415f-8baf-917427c442e6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.751713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.753140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.753623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.754095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.755915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:20.757690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:20.759653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 214/411] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:20.765787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.787961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09204-d7bd-4cac-a6d5-a48ef7bb142a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.863695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.864668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.865023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.865376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] PATH_INFO: `/v3/projects/a135c41fcf464430b5b4b85603ac96eb` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.867591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=a135c41fcf464430b5b4b85603ac96eb)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:20.869189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:20.874099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 198/412] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/projects/a135c41fcf464430b5b4b85603ac96eb => generated 344 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:20.878285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:20.880620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307965b-3267-4280-b4b3-ae9ac986229f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:20.918148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:20.920323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:20.920804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:20.921294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:20.922772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:20.924843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:20.927360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 215/413] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:20 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:20.933817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:21.048518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ec5cc-b881-435a-b122-cc6712a0fced None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:21.087957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dfd11-a87d-4552-aebf-5f6e62189886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:21.089191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dfd11-a87d-4552-aebf-5f6e62189886 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:21.089693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dfd11-a87d-4552-aebf-5f6e62189886 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:21.090435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dfd11-a87d-4552-aebf-5f6e62189886 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:21.093516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dfd11-a87d-4552-aebf-5f6e62189886 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d9242e9cb643889e745d0f280085cd, group_id=1852cb1d77264b71a4d04e7ef0605b78, role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:21.095244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dfd11-a87d-4552-aebf-5f6e62189886 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:21.101971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5a8f8-9e8e-4e1a-a1d6-ff9559a9f6a9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:21.125257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 216/414] 10.222.0.84 () {58 vars in 1442 bytes} [Fri May 13 18:13:20 2022] PUT /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd/groups/1852cb1d77264b71a4d04e7ef0605b78/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:21.151111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59d0f4-0105-4fd3-88d0-1a81de714b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:21.152456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59d0f4-0105-4fd3-88d0-1a81de714b78 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:21.157914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59d0f4-0105-4fd3-88d0-1a81de714b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:21.158531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59d0f4-0105-4fd3-88d0-1a81de714b78 None admin] PATH_INFO: `/v3/projects/a135c41fcf464430b5b4b85603ac96eb/groups/67ec9e5967b24daaa2a7514ee020c86f/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:21.163881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59d0f4-0105-4fd3-88d0-1a81de714b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=a135c41fcf464430b5b4b85603ac96eb, group_id=67ec9e5967b24daaa2a7514ee020c86f, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:21.165763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59d0f4-0105-4fd3-88d0-1a81de714b78 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:21.188297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 199/415] 10.222.0.84 () {58 vars in 1442 bytes} [Fri May 13 18:13:20 2022] PUT /identity/v3/projects/a135c41fcf464430b5b4b85603ac96eb/groups/67ec9e5967b24daaa2a7514ee020c86f/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:21.491369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59446-b454-487b-91f7-8a1a2da25c1c None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:21.491877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59446-b454-487b-91f7-8a1a2da25c1c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:21.491954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59446-b454-487b-91f7-8a1a2da25c1c None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:21.493418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 217/416] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:21.499099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:21.499397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:21.499683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:21.521996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:21.523174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:21.608819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 200/417] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:21.632975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59446-b454-487b-91f7-8a1a2da25c1c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:21.771588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59446-b454-487b-91f7-8a1a2da25c1c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:21.816065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:21.816906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:21.817190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:21.817470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:21.836154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:21.845111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:21.846077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:21.846951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 218/418] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:21.853772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:22.009276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a604a00-c652-46aa-9a04-6ec420a8fb11 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:22.054040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:22.054682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.054970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.055247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.056017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:22.056321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:22.057705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dede8-d1c5-4ede-a442-978a9010307c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:22.069197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 201/419] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:22.075635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:22.214253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438736-9064-4ab2-900c-554fb555fc26 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:22.257500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:22.258181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.258467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.258744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.289763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881227-8d90-4ca5-a763-3a2124fba27e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.290100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881227-8d90-4ca5-a763-3a2124fba27e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.290359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881227-8d90-4ca5-a763-3a2124fba27e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.291976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 202/420] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:22.297956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.298240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.298519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.329697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:22.331016 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:22.333216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:22.334706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:22.446574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 219/421] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:22.452566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:22.501714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 203/422] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:22.546483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:22.630587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337ef3-d530-4eb3-8da0-da351c1523d4 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:22.700760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e065a4-aa12-41b8-962a-27ecff5ce81a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:22.710234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:22.711175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.711463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.711744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.712979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:22.722709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:22.725018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 220/423] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:22 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:22.733233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:22.744986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:22.745892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.746210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.747025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.767013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:22.776613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:22.777734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:22.778562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:22.780205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 204/424] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:22.790869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:22.881767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd32a4-a4cc-402d-91e3-1d942b7f6506 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:22.922846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:22.924073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:22.924559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:22.925057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:22.927591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:22.929294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:22.934579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 221/425] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:22 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:22.940520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.031296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a99127-99d3-4b7d-9cc7-ba95beb25414 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.071787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.072832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.073315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.073790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.076539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:23.077260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.078903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.089733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 205/426] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:23.102470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.166388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c3d7-1a79-4305-9e53-1a2c7a617e62 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.210637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.211720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.212107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.212485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.213950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:23.214378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.217905 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc08f-e991-4dce-9ccb-512b2b126cb2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.220177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f8842-d0d8-4d66-b92a-5dc233f8be74 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.229832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 222/427] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:22 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 611 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:23.229832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3347b6-b68f-4f69-b6c8-24e40cdd6112 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.229832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3347b6-b68f-4f69-b6c8-24e40cdd6112 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.229832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3347b6-b68f-4f69-b6c8-24e40cdd6112 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.229832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 223/428] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:23.236904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.237461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.237921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.260106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:23.263359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:23.311898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.312710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.313090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.313463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.353952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 224/429] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:23.379026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.503045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.504512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.504988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142f29-b1f1-4899-b43d-db951251e386 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.556382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.557190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.557476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.557752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.576459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:23.584417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:23.585337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 18:13:23.586168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:23.590109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 225/430] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:23.591842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.641830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 206/431] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:23.648945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.695605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b198-b6c0-4066-bf02-2f730feabdb5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.735060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.736011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.736467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.736914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.737908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] RBAC: Adding query filter params (name=member) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:23.738870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.741517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.751602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 226/432] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:23.762324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.767943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3a46-18ee-4488-9982-72b8dbd85d6e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.820145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.821339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.821624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.821945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] PATH_INFO: `/v3/projects/e77e4ed0d3164aa192dc64d4affa8503` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.823888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] RBAC: Authorizing `identity:get_project(project_id=e77e4ed0d3164aa192dc64d4affa8503)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.826705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.829766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 207/433] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:23 2022] GET /identity/v3/projects/e77e4ed0d3164aa192dc64d4affa8503 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:23.834956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:23.876137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141665-48c4-4f85-8329-22df49faa09d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.911352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1464c-12fa-428f-a54b-974527a9a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.912008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1464c-12fa-428f-a54b-974527a9a90b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.912296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1464c-12fa-428f-a54b-974527a9a90b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.912573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1464c-12fa-428f-a54b-974527a9a90b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.940352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0490f-fd3f-490b-99ed-9bdd2bde7e26 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:23.982421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd5228-45b7-498f-9afc-d0bd7626abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:23.983625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd5228-45b7-498f-9afc-d0bd7626abb9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.984102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd5228-45b7-498f-9afc-d0bd7626abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.984205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1464c-12fa-428f-a54b-974527a9a90b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.984693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd5228-45b7-498f-9afc-d0bd7626abb9 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.985668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1464c-12fa-428f-a54b-974527a9a90b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.986387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd5228-45b7-498f-9afc-d0bd7626abb9 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:23.987990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd5228-45b7-498f-9afc-d0bd7626abb9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:23.994071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 208/434] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:23 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:23.995631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a8dc3-61fc-4b3d-a1d6-dcde62997fa7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.995922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a8dc3-61fc-4b3d-a1d6-dcde62997fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.996309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a8dc3-61fc-4b3d-a1d6-dcde62997fa7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:23.997904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 209/435] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:23.998984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1b30f-8d32-4a8b-a63d-9a9f2394cd70 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:23.999316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1b30f-8d32-4a8b-a63d-9a9f2394cd70 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:23.999594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1b30f-8d32-4a8b-a63d-9a9f2394cd70 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.000983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 210/436] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:24.001519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1b30f-8d32-4a8b-a63d-9a9f2394cd70 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.086361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 227/437] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:24.087689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.087976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.088257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.104891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:24.106782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:24.106934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1b30f-8d32-4a8b-a63d-9a9f2394cd70 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.151103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.151846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.152199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.152555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.154870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=e77e4ed0d3164aa192dc64d4affa8503) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:24.155437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:24.158155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ee94-0562-4b5b-8f05-9ddd432c54d1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:24.168116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 211/438] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=e77e4ed0d3164aa192dc64d4affa8503&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:24.169941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.170226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.170505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.192037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:24.193304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:24.207684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 228/439] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:24.208588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.281841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 212/440] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:24.283744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.335936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad785e3-ca8f-4e6f-a883-1ffa045b4f95 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.374211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.375546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.375829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.376105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.377703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:24.379187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:24.380908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 229/441] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:24.381674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.407720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d14d03-7fb7-45ba-9021-7821c267c501 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.445623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.446098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.446379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.447733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.462094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:24.470833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:24.471771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:24.473104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 213/442] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:24.474376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.506233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481df45-74d8-4caa-b885-8fe341dc1028 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.546596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.547452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.548996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.548996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.560989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:24.569398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:24.570323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:24.571104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 230/443] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:24.571748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.585141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae3387-ac03-4ade-b5ea-fb0dc5919bda None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.625338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.625338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.625338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.625338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.626580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:24.628413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:24.630370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 214/444] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:24.631000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.691376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c82d-93b5-470e-860a-50c71fd9e9cf None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.727934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.728643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.728885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.729166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.729959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:24.730274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:24.732618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:24.742261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 231/445] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:24.743742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.755510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084219ea-a73a-4656-9508-68d6e4bf3539 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.788433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.789074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.789715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.790023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.790776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:24.791085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:24.792457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:24.800921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 215/446] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:24.801651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.846739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb3a6-4a66-4624-9a69-c84c53886390 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.879470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.880120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.880662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.880937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.881756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=f02eb0a3ac994ebe8b0e1c9f167d281e, scope.project.id=a5d9242e9cb643889e745d0f280085cd) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:24.882095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:24.883505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:24.889301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 232/447] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=f02eb0a3ac994ebe8b0e1c9f167d281e => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:24.890111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:24.899939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021058-8980-4e0d-a70f-7aa22d29243a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:24.937656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:24.938435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:24.938724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:24.939057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:24.995792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03859553-ac19-4204-af94-e7cf994ba8b3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.010472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.012536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.031684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.032605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.033029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.033444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.106456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.107913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.119077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 216/448] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:25.125474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:25.222260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 233/449] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:25.228932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:25.241888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27bb22-36cd-4ada-9196-00186fc128d3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.278452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.279309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.279585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.279855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] PATH_INFO: `/v3/projects/a135c41fcf464430b5b4b85603ac96eb` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.281581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] RBAC: Authorizing `identity:get_project(project_id=a135c41fcf464430b5b4b85603ac96eb)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.282963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 217/450] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:25 2022] GET /identity/v3/projects/a135c41fcf464430b5b4b85603ac96eb => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:25.289652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:25.335801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93855503-8034-45ac-9420-b1c3549761ba None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.368408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.369186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.369464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.369728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] PATH_INFO: `/v3/projects/a5d9242e9cb643889e745d0f280085cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.370934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d9242e9cb643889e745d0f280085cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.373011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.374725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 234/451] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:13:25 2022] GET /identity/v3/projects/a5d9242e9cb643889e745d0f280085cd => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:25.380232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:25.385149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9539d2-0fb8-41e8-9983-ced5ac1860c8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.417501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.418511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.418799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.419074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] PATH_INFO: `/v3/groups/67ec9e5967b24daaa2a7514ee020c86f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.420247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] RBAC: Authorizing `identity:get_group(group_id=67ec9e5967b24daaa2a7514ee020c86f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.421687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.423313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 218/452] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:25 2022] GET /identity/v3/groups/67ec9e5967b24daaa2a7514ee020c86f => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:25.428967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:25.477639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f080264-6cd2-4d06-ba81-f6abe5994a34 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.511048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.512964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.513258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.513541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] PATH_INFO: `/v3/groups/1852cb1d77264b71a4d04e7ef0605b78` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.514802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] RBAC: Authorizing `identity:get_group(group_id=1852cb1d77264b71a4d04e7ef0605b78)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.516247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.517895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 235/453] 10.222.0.84 () {56 vars in 1180 bytes} [Fri May 13 18:13:25 2022] GET /identity/v3/groups/1852cb1d77264b71a4d04e7ef0605b78 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:25.523638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:25.526448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc30b41-fd2f-49e0-9974-a073b6c763e7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.559270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.559965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.560242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.560519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.561347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] RBAC: Adding query filter params (group.id=67ec9e5967b24daaa2a7514ee020c86f, role.id=86c6955a20734baf912fede27a24309e, scope.project.id=a135c41fcf464430b5b4b85603ac96eb) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:25.561656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.563128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3a928-7705-487f-9ed2-528a30039929 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.568841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 219/454] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:25 2022] GET /identity/v3/role_assignments?group.id=67ec9e5967b24daaa2a7514ee020c86f&scope.project.id=a135c41fcf464430b5b4b85603ac96eb&role.id=86c6955a20734baf912fede27a24309e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:25.626122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729bb5f-c203-4964-8187-d664faab495f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:25.661492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:25.662253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:25.662533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:25.662802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:25.663637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] RBAC: Adding query filter params (group.id=1852cb1d77264b71a4d04e7ef0605b78, role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=a5d9242e9cb643889e745d0f280085cd) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:25.663945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:25.665389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c33e-f88c-411c-a3be-d1d3ac742603 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:25.672778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 236/455] 10.222.0.84 () {56 vars in 1376 bytes} [Fri May 13 18:13:25 2022] GET /identity/v3/role_assignments?group.id=1852cb1d77264b71a4d04e7ef0605b78&scope.project.id=a5d9242e9cb643889e745d0f280085cd&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:28.880193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b978fa-7bf3-43ad-ac99-3e6d010237cf None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:28.881212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b978fa-7bf3-43ad-ac99-3e6d010237cf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:28.881704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b978fa-7bf3-43ad-ac99-3e6d010237cf None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:28.883525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 220/456] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:28.889979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ad62d-beee-47ce-bd4c-84526846e1e1 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:28.890944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ad62d-beee-47ce-bd4c-84526846e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:28.891424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ad62d-beee-47ce-bd4c-84526846e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:28.918425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-417ad62d-beee-47ce-bd4c-84526846e1e1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:28.920582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-417ad62d-beee-47ce-bd4c-84526846e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:29.007284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 237/457] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:29.047764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b978fa-7bf3-43ad-ac99-3e6d010237cf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.087040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0b93-657b-46bd-9742-c3feac5f199f None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.087677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0b93-657b-46bd-9742-c3feac5f199f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.088153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0b93-657b-46bd-9742-c3feac5f199f None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.091932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 238/458] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:29.096797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cfafd-c46e-4bfd-b5a2-a0783d331600 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.097341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cfafd-c46e-4bfd-b5a2-a0783d331600 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.097860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cfafd-c46e-4bfd-b5a2-a0783d331600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.117379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-133cfafd-c46e-4bfd-b5a2-a0783d331600 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:29.119022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-133cfafd-c46e-4bfd-b5a2-a0783d331600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:29.171266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b978fa-7bf3-43ad-ac99-3e6d010237cf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.197902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 239/459] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:29.200273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8feb54-d4bb-4a9e-a407-0215792da328 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.200917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8feb54-d4bb-4a9e-a407-0215792da328 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.201392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8feb54-d4bb-4a9e-a407-0215792da328 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.203304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 240/460] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:29.208774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.209341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.209845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.219591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.220407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.220690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.220963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.230187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:29.232191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:29.238521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.239980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:29.263853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:29.264768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:29.265609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:29.265609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:29.265609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:29.265609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:29.270185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 221/461] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:29.271074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.310412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 241/462] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:29.311532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.393246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8383d9-f54a-4815-893c-f72c9ae03303 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.410911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f90eb8-2e32-4693-abe6-b15f92cb7095 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.425896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.426648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.426933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.427210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.438148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.439614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.446009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.446508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.446795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.447062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.447788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:29.448091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.450135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-773050e1-e977-45e1-8e5f-a4d909ce3082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:29.457191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:29.458097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:29.458983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:29.458983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:29.458983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:29.458983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:29.458983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 222/463] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:29.459659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a14d-972b-43c9-b537-6cb58ab6b27b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.463667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a14d-972b-43c9-b537-6cb58ab6b27b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.464133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a14d-972b-43c9-b537-6cb58ab6b27b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.466636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 223/464] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:29.467518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a14d-972b-43c9-b537-6cb58ab6b27b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.467771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 242/465] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:29.468868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.574265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a14d-972b-43c9-b537-6cb58ab6b27b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.582597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f88cf-1c6b-4f69-b940-56862331077a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.609453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.610294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.610582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.610862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.622037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.622911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.623651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.623790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.624048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.624318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.625049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:29.625359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.626757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.643107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 243/466] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:29.643107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8ca3d1b0-154f-42a6-9ccd-434913597a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:29.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:29.644135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 224/467] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.644974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.662819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:29.664018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:29.728706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 225/468] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:29.729455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.764274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3679f-ab7f-4a14-93da-0c2f71537d04 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.800240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.801495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.802437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.802908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.804027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.806621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.838140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 244/469] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:29 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:29.838140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.869922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2541-c038-4bd6-81d1-bb49eda0a449 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:29.911217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:29.911884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:29.912166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:29.912446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:29.913167 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:29.914751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:29.939309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 226/470] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:29 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:29.940234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:29.960013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5700-c749-4644-aac8-8a0d78d2fafd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.026258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.026855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.027755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.028034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.028777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:30.029084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.030534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.052121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 245/471] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:30.058174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:30.061095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d685cff-cf62-41d0-8f87-8397d5520c04 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.098241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.099443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.099778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.100118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.112826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.114926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b42a27bc-3a8e-4038-95b9-6960bd6276e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:30.133963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:30.134901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:30.135751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:30.135751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:30.135751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:30.135751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:30.137987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 227/472] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:30.144157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a625-7fd8-4b57-9bfe-8b8a1804ec92 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.144665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a625-7fd8-4b57-9bfe-8b8a1804ec92 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.145114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a625-7fd8-4b57-9bfe-8b8a1804ec92 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.147004 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 228/473] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:30.147979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a625-7fd8-4b57-9bfe-8b8a1804ec92 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:30.183086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e8c7-5ffa-4d93-80fb-752c5358320c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.224052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c13216-e344-4fe4-bc0a-22f76069802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.224746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13216-e344-4fe4-bc0a-22f76069802d None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.225033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13216-e344-4fe4-bc0a-22f76069802d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.225313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13216-e344-4fe4-bc0a-22f76069802d None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.226104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c13216-e344-4fe4-bc0a-22f76069802d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.227585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c13216-e344-4fe4-bc0a-22f76069802d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.257216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 246/474] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:30 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:30.257216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.257216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.257216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.273595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:30.274872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:30.291161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a625-7fd8-4b57-9bfe-8b8a1804ec92 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.329551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.330691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.330977 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.331579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.332654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:30.332973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.334642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.360798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 229/475] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:30.362200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 247/476] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:30.366668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:30.398608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:30.486700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd6352-7b5b-4075-9f6e-92e1484d9892 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.514666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74a80-bcf1-409d-a782-3451ed7e8538 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.522762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.523659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.524095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.524364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.525246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.526877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.552389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 230/477] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:30 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:30.555226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.555412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.555883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.556351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.557022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.561465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.567793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.sql.core [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 18:13:30.567793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 18:13:30.567793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [parameters: {'id': 'e89619a9602d49aeb4db022b04f0addd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 18:13:30.567793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79983) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result = self._query(query) May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application conn.query(q) May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result.read() May 13 18:13:30.586878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return ref.to_dict() May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 18:13:30.587800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application next(self.gen) May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application yield resource May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application next(self.gen) May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.session.rollback() May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.force_reraise() May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise self.value May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application session.commit() May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 18:13:30.588977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._prepare_impl() May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.session.flush() May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._flush(objects) May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application compat.raise_( May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application flush_context.execute() May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rec.execute(self) May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 18:13:30.590696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 18:13:30.591660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result = self._query(query) May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application conn.query(q) May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result.read() May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 18:13:30.592527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [parameters: {'id': 'e89619a9602d49aeb4db022b04f0addd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:30.593327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 18:13:30.594282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:30.595128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 248/478] 10.222.0.84 () {60 vars in 1131 bytes} [Fri May 13 18:13:30 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:30.596747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:30.735211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa7077-06e5-4252-9ba4-80f9ba604950 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.773274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8d6e7-df50-41f6-a028-77ed43f8d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.774371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d6e7-df50-41f6-a028-77ed43f8d9fe None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.774824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d6e7-df50-41f6-a028-77ed43f8d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.775240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8d6e7-df50-41f6-a028-77ed43f8d9fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.786593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8d6e7-df50-41f6-a028-77ed43f8d9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9ad8d6e7-df50-41f6-a028-77ed43f8d9fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:30.795169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:30.796261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 18:13:30.797267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:30.799666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 231/479] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:13:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:30.804851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:30.916871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1198ad-ec1b-4d98-b5fa-5fb86d4d03e8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:30.955831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:30.956511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:30.956798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:30.957080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:30.957884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:30.958201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:30.959645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff00fd-658c-45f0-a3a7-6d7965232ed1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:30.970098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 249/480] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:32.451652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672369c1-d0df-4d32-9340-07f0593d3497 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:32.452178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672369c1-d0df-4d32-9340-07f0593d3497 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:32.452253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672369c1-d0df-4d32-9340-07f0593d3497 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:32.453882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 232/481] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:32.468502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:32.468983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:32.469055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:32.503321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:32.504525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:32.600305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 250/482] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:32.647965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672369c1-d0df-4d32-9340-07f0593d3497 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:32.804090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672369c1-d0df-4d32-9340-07f0593d3497 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:32.853362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23453c-d1cd-47f0-b044-8d8f234926e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:32.854186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23453c-d1cd-47f0-b044-8d8f234926e7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:32.854468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23453c-d1cd-47f0-b044-8d8f234926e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:32.854746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23453c-d1cd-47f0-b044-8d8f234926e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:32.878721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23453c-d1cd-47f0-b044-8d8f234926e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-be23453c-d1cd-47f0-b044-8d8f234926e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:32.887346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:32.888437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:32.889864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 233/483] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:32.894898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:32.979204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aae61f-95f3-411e-b551-b2bdeaaacd13 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:32.979539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aae61f-95f3-411e-b551-b2bdeaaacd13 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:32.979770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aae61f-95f3-411e-b551-b2bdeaaacd13 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:32.982593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 234/484] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:32.999526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98e66-2292-43b8-ad43-812d72539428 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:32.999825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98e66-2292-43b8-ad43-812d72539428 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.000096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98e66-2292-43b8-ad43-812d72539428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.036446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a5d98e66-2292-43b8-ad43-812d72539428 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:33.037764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a5d98e66-2292-43b8-ad43-812d72539428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:33.055185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a11f-7cf2-4f6d-b3a4-73c6014aee99 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.094221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.095076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.095359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.095635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.096535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:33.096847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.098261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.108040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 251/485] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:33.114236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.165679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 235/486] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:33.172611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0280bd-55ca-4f78-9cc1-f41e037e3d4a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.172894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0280bd-55ca-4f78-9cc1-f41e037e3d4a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.173169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0280bd-55ca-4f78-9cc1-f41e037e3d4a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.174873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 236/487] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:33.185962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.186251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.186530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.213572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:33.215638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:33.264107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73401a3e-17a6-4d5b-9f82-161e892b5831 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.293821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 237/488] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:33.293821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.321639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.322807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.323292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.323796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.335838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.337602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:33.355586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:33.356460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:33.357399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:33.357399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:33.357399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:33.357399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:33.359638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 252/489] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:33.360645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.410252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8f353-34aa-46e5-b248-8c45072caf53 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.455328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.456118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.456398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.456671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.469497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:33.477629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:33.478726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:33.479547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:33.482591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102daa4-13ce-4b91-8fd8-acbba0f4ab28 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.484358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 238/490] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:33.485224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.520215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.521381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.521940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.522428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.533658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:33.542143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:33.543128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:33.543943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:33.546813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 253/491] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:33.552483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.588576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6eb0-b11f-46bd-9c91-e10d1a73b73d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.622447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.623108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.623387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.623656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.624377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:33.624679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.626074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.638153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 239/492] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:33.638980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.659962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d280564-6971-4df6-91a1-8c6d68e212c3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.693601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.694303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.694601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.694872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.695627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:33.695934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.697313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839618-8cec-411b-9c00-0294a8c4eb8b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.706421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 254/493] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:33.707735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa394-0b37-4450-8ac9-9f5a1133228d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.708028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa394-0b37-4450-8ac9-9f5a1133228d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.708310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa394-0b37-4450-8ac9-9f5a1133228d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.709553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 255/494] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:33.713948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa394-0b37-4450-8ac9-9f5a1133228d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.741031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6eb08-a7d7-4926-8262-262aaa3530e4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.774672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.775334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.775614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.775885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.776633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:33.777002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.778426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.791466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 240/495] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:33.791466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.819390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa394-0b37-4450-8ac9-9f5a1133228d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.853225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.853961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.854240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.854518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.862531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.864247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-e654b3c9-cdb7-4ebc-b7e8-2d7f44feb1d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:33.879490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:33.880428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:33.881320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 256/496] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:33.881921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.882317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.882421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.897608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a79b5-9df7-49aa-bd01-ba6e85bad3ca None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:33.898891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:33.900082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:33.933963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:33.934802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:33.935108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:33.935362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:33.946107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:33.947578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:33.964644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:33.965508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:33.975283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:33.975283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:33.975283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:33.975283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:33.975545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 257/497] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:33.975639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 241/498] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:33.975639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:33.975782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.080201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d1501-662e-4eed-a09d-6b1c98aff9a1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.088587 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3c7b-58a3-4f15-b002-e204efa1e0bd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.114399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.115415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.115854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.116122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.123548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.124290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.124643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.124986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.125919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:34.126297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.126535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.127857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.127972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:34.145714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:34.146845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:34.147921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:34.147921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:34.147921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:34.147921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:34.150104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 258/499] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:34.151092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.166730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 242/500] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:13:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:34.168317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.255749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dda36-21a1-4d06-87c6-33ac7c970484 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.265699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c151b4-51b1-4547-be2e-d0023215de04 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.290263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.290927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.291203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.291475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.292185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:34.292509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.293904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.299063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.299882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.300213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.300401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.305153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 259/501] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:34.306122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.312066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:34.319906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:34.320946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:34.321758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 243/502] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:34.322465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.401897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884ee0a-b72f-4c06-a78d-8ff15ff21c47 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.416997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7093c1-f62c-491d-a148-399b46ad7546 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.434364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.435017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.435292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.435561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.436272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:34.436574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.437980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecd47b-70a2-4163-95fa-3b8ac85217aa None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.448670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 260/503] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:34.449896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb925-0dce-4f37-9728-ec7a49f722e8 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.450348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb925-0dce-4f37-9728-ec7a49f722e8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.450450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb925-0dce-4f37-9728-ec7a49f722e8 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.450978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.451633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.453927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.454021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 261/504] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:34.454109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.454191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb925-0dce-4f37-9728-ec7a49f722e8 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.518315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.519770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.553361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb925-0dce-4f37-9728-ec7a49f722e8 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.586582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.587371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.587762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.587929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.595877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.597420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:34.612263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:34.613453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:34.614377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 262/505] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:34.615599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.615666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 244/506] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:34.615666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.710624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c12d2-1ea6-4ec1-a290-9937cb9e6b71 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.712586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e168-b68c-4d85-b8ed-9e1d9e9ebfe2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.756515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.757742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.757896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.758284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.758734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.758822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.759242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.759697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.760978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:34.762045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.763644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916957f-6018-4073-9e9c-d3ac0413284e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.767619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.769061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.772441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 263/507] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:34.772667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.772958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.773238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:34.788218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:34.789197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 245/508] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:34.795332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.795947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:34.795947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:34.858010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 264/509] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:34.858856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.890705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a8885-b5dc-4f47-8084-0444fb37251c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.921866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.922529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.922803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.923072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:34.923919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:34.924205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:34.925630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:34.943480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 246/510] 10.222.0.84 () {56 vars in 1137 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:34.944117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:34.956392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063772c-6bad-4853-b17d-42b56b08a772 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:34.988417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:34.989119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:34.989394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:34.989662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.015567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.017163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:35.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:35.036358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:35.037383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:35.037383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:35.037383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.037383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:35.037938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 265/511] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:35.038764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.043870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b115754-cfb6-4080-9ac3-9a38e3ac6b21 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.079035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.079831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.080113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.080387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.091569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.093049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:35.111829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:35.112903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:35.114187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:35.114187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:35.114187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.114187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:35.114187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 247/512] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:35.114187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.147194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4f51e-c01d-4589-8972-cbb7044002cd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.181494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.182196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.182485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.182762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.184507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:35.184822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.186302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.222301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 266/513] 10.222.0.84 () {56 vars in 1137 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:35.223152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.224862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4befc6c-1650-4971-9b32-195bb78a579f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.258889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.259593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.259919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.260142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.270845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.272292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:35.289758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:35.290853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:35.291738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:35.291738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:35.291738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.291738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:35.291738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 248/514] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:35.292067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.324054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612844b-8ac5-41bb-9e69-e583626e95b1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.356139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341850d-7878-4894-9106-d43d135e271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.356773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341850d-7878-4894-9106-d43d135e271e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.357054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341850d-7878-4894-9106-d43d135e271e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.357329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341850d-7878-4894-9106-d43d135e271e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.388267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48075-afa6-47e0-b4af-1a1472fe1852 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.421901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.422555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.422834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.423105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.423819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:35.424118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.424376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341850d-7878-4894-9106-d43d135e271e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.425483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.425860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341850d-7878-4894-9106-d43d135e271e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.436404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 249/515] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:35.437198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.521644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 267/516] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:35.522733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341850d-7878-4894-9106-d43d135e271e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.534320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750afc6-dce6-42fe-bca5-b97b48239227 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.567254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.567912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.568196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.568467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.569183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:35.569490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.570901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.582907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 250/517] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:35.583888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.622247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341850d-7878-4894-9106-d43d135e271e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.654662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.655336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.655619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.655895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.681590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1548504-21fd-4d25-91df-69c06978a437 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.714502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.715276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.715555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.715834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.716550 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:35.716854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.718250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.721113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.722578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.729123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 251/518] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:35.729993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.824865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 268/519] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:35.825931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.848982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693e8a-a235-430a-8e2d-157645f01d7e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.882648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.883432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.883716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.883994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.891321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.892763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:35.907887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:35.908844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:35.909758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 252/520] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:35.910585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:35.926371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ee50-9d96-43d8-b8ea-0eaeb7c38258 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:35.959302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:35.960093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:35.960377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:35.960653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:35.970749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:35.972213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:35.990119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:35.991150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:35.992191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:35.992191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:35.992191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:35.992191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:35.992191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 269/521] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:35.992191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.008302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae43f-c1b6-4b3f-b2ef-12f113a2cd39 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.040384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.041174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.041458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.041732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.049343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.050913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:36.066857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:36.068018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:36.069117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 253/522] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:36.069827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.091634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840c0f-e9ec-4469-bddb-720e663a995f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.124639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.125312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.125591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.125900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.126596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.128027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.146449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 270/523] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:35 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:36.147399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.168247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b15f2-2589-458a-8ec7-4fd0727d12c5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.206564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.207670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.208095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.208531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.220529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.222045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:36.241744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:36.242726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:36.243568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:36.243568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:36.243568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:36.243568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:36.247947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 254/524] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:36.247947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.257247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce785-569e-41bd-b1f0-c9515c6aa789 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.293673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.294386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.294669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.295014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.295826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:36.296139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.297622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.322251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 271/525] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:36.323077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.354399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326fd18-0813-4258-9813-6e57138e7885 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.391022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.392070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.392537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.392963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.393825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:36.394155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.395521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.408165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 255/526] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:36.412848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.426153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430e576-a69a-4308-934c-12d3cf8abae7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.462990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.463669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.463952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.464250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.465735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:36.466101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.467576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.491952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 272/527] 10.222.0.84 () {56 vars in 1139 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:36.491952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.510906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b621c1-5a27-4ef3-bc2f-da06c961552e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.546840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.547527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.547788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.548060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.548789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:36.549096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.550571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.563049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 256/528] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:36.564236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.589250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ce01-8730-479e-9f37-ae85a985704e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.623589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.624215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.624440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.624697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.625533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=b5e358b1f53b408f8f1e9661ac754c39) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:36.625869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.627296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.632669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 273/529] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/role_assignments?user.id=b5e358b1f53b408f8f1e9661ac754c39&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:36.633459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.672109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73b8fb-ea33-4898-9372-4f91d7504590 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.710352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.711159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.711441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.711716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.719584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.721052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:36.736242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:36.737153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:36.738311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:36.742950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 257/530] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:36.743940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.753360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722513a-41fa-414e-b049-7c3f1f5f89ff None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.791319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.792421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.792929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.793411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.862829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93a149-d36e-4b62-8fdb-1bce2d20ba0a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:36.864861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.866375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.898173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:36.898883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:36.899162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:36.899434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:36.907293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:36.908757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:36.923414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:36.924332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:36.925161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 258/531] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:36.925618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:36.973297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 274/532] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:36.974191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.028382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f97a24-bffb-42de-9bf7-3173d51c9f10 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.063192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.063854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.064133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.064407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.065191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:37.065496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.066973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.075046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ec99-251e-4199-8194-90fa3986eddd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.084443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 259/533] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:37.085272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.115429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.116093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.116376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.116651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.117442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:37.117753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.119231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.136919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 275/534] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:37.137857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.193019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076bb4a-7df2-4e3b-a38d-76ec1a88c8be None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.239617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e1832-8cae-4880-8ddf-a39bb2570a5c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.240219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.241425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.244403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.244934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.258818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.260606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.275034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.275736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.276017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.276287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.277674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=7bd83f55b1a84d1894d19a505bcc18c0) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:37.278111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.279549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.285451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 276/535] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:37 2022] GET /identity/v3/role_assignments?user.id=7bd83f55b1a84d1894d19a505bcc18c0&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:37.285973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:37.286825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:37.287754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:37.287754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:37.287754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:37.287754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:37.287976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.294883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 260/536] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:37.302895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.418512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47c1b7-3261-4cc5-adcf-f1ef684cbf35 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.499246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.500293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.500791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.501278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.502366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=a50eb00b59c3432bb7c085d3d8287ea4) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:37.502914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.504578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.514065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3866f5-71d7-4734-bccf-14e54f89ceb4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.517572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 277/537] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:37 2022] GET /identity/v3/role_assignments?user.id=a50eb00b59c3432bb7c085d3d8287ea4&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:37.564538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.565226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.565484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.565757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.566544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:37.566848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.568246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.581642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 261/538] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:37.587014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.750501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398403-9a73-4080-91e2-e94a40dde883 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.788893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.790185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.790475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.790750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.797975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.799470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:37.816477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:37.817377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:37.818271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 278/539] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:37.828809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:37.957570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c97a6-c761-48aa-9b66-4aed8d75f147 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:37.993292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:37.993989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:37.994270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:37.994557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:37.995339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:37.995721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:37.997248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1227152-e6f3-4efb-a3f8-269e14b7db20 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:38.011762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 262/540] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:38.018874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:38.134211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161a6f-ea6b-4a3c-b165-89c7441e9c08 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:38.170548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:38.171259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:38.171545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:38.171822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:38.172663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=5b6ddbd6cd3f4f238fb1a23a04a99401) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:38.172976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:38.174438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4fbe7-fdc7-4f48-83b8-bfa537560c6b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:38.180585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 279/541] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:38 2022] GET /identity/v3/role_assignments?user.id=5b6ddbd6cd3f4f238fb1a23a04a99401&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:38.687501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eaa22-a738-4c90-b150-f088fd3c59b7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:38.688039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eaa22-a738-4c90-b150-f088fd3c59b7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:38.688039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eaa22-a738-4c90-b150-f088fd3c59b7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:38.689673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 263/542] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:38.695109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:38.695402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:38.695684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:38.715284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:38.716380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:38.786324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 280/543] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:38.833964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eaa22-a738-4c90-b150-f088fd3c59b7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:38.941415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eaa22-a738-4c90-b150-f088fd3c59b7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:38.977134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:38.977938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:38.978220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:38.978537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:38.989810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:38.997886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:38.998789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:38.999583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 264/544] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:39.006259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.121325 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5fd1-f5a5-4bb4-aefc-7f4956eaa6d3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:39.156227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:39.156907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.157191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.157466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.158250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:39.158558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:39.159944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:39.169462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 281/545] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:39.174865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.288791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c1186-9ae5-493c-adf9-f88e446fe99b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:39.327060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:39.327867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.328154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.328428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.339987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:39.341432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-80164e84-859c-43fb-9ab3-a2c742d4ae79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:39.359325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:39.361272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:39.362487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:39.362487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:39.362487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:39.362487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:39.362487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 265/546] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:39.371858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.512981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726235-0cf6-4f30-84fe-c7727affb26d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:39.516536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5d991-82cf-45df-b75c-e1ab6039f567 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.516827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5d991-82cf-45df-b75c-e1ab6039f567 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.517105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5d991-82cf-45df-b75c-e1ab6039f567 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.519685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 266/547] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:39.525772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.526449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.526776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.546251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:39.547560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:39.575345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:39.576015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.576298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.576573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.577302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:39.577606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:39.579017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:39.608186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 282/548] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:39.613837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.627680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 267/549] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:39.653342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.768567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3718019-105f-4f88-8981-3b6b273bb92a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:39.772226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81626-4272-49cc-b906-734c4c74c67a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:39.804288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:39.805002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.805282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.805556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.817680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:39.826048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:39.828234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:39.830221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 268/550] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:39.831805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:39.831805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.831805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.831805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.837721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.858689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:39.860172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:39.903457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:39.905671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:39.907907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 283/551] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:39.914821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:39.946118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4399e3-0195-4d70-904d-6893da367466 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:39.992541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:39.993535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:39.994043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:39.994511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:39.995607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:39.996367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:39.998063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.017362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 269/552] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:40.022581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.067266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e8b51-169e-460d-91ba-56f1d53889f9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.109864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.110682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.111161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.112561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.113927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:40.114413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:40.115955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.139838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 284/553] 10.222.0.84 () {56 vars in 1135 bytes} [Fri May 13 18:13:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:40.145410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.252656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b616-c1cb-483b-a213-84d5986c6643 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.288436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4a4a-65c6-46da-a117-b114c675b62a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.305202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.306042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.306323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.306599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.317400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:40.318798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.326151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4aa4f-7bc4-4671-aec8-53adfadf4688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.327053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4aa4f-7bc4-4671-aec8-53adfadf4688 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.327559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4aa4f-7bc4-4671-aec8-53adfadf4688 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.328034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4aa4f-7bc4-4671-aec8-53adfadf4688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f0b8184c-c6a3-42b1-aebe-13f1f499ccc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:40.335753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:40.336721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:40.337622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:40.337622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:40.337622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:40.337622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:40.337622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 270/554] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:40.338517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08dcb-e970-45b5-914a-25c6bbc040c0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.338790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08dcb-e970-45b5-914a-25c6bbc040c0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.339560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08dcb-e970-45b5-914a-25c6bbc040c0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.340999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 271/555] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:40.341899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488c61-31a8-4019-9710-9de177bb9e02 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.342193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488c61-31a8-4019-9710-9de177bb9e02 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.342442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488c61-31a8-4019-9710-9de177bb9e02 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.343634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 272/556] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:40.344319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34488c61-31a8-4019-9710-9de177bb9e02 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.413425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4aa4f-7bc4-4671-aec8-53adfadf4688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:40.415069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4aa4f-7bc4-4671-aec8-53adfadf4688 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.448423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34488c61-31a8-4019-9710-9de177bb9e02 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.487675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.488606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.488886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.489157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.489911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:40.490215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:40.491579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2c491-9fa4-468a-8cce-461c1361986f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.506064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 273/557] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:40.507511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.507864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.508207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.528354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 285/558] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:40.528354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.528354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.528354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.528746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:40.528746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:40.544469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:40.545921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:40.593484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 274/559] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:40.594624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.629866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 286/560] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:40.629866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.715522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25aa5e-680a-497f-ad85-1f67421f880d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.731005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf8e5b-5bb2-4dd3-82f3-d1bf22c83bc3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.749198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.750024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.750310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.750588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.757602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:40.759091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.764422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.765213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.765488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.765755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:40.774352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:40.775604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:40.776547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 275/561] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:40.778341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.780923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:40.780923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:40.800216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:40.801295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:40.802364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:40.802364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:40.802364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:40.802364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:40.806032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 287/562] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:40.806908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.882507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf7897-8af5-4fda-b476-6bb41d4a2d6e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.911026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe93e1-e750-43fb-a92a-27f0a9113195 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:40.920287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.921406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.921681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.921986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.933644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:40.941690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:40.943527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:40.944515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:40.947560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 276/563] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:40.948351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:40.954258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:40.955055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:40.955333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:40.955602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:40.966368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:40.974100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:40.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:40.975808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:40.980126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 288/564] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:40.980917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.050089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1637-e8c6-4091-9190-9f84bf74e8bb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.080878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3eb123-9fa4-4cd1-a954-cd5429b4305a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.082700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.083379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.083662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.083940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.084781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.085089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.086552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.104171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 277/565] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.105747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.115501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.116165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.116438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.116706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.117425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.117723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.119122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.130560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 289/566] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.131434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.201895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f91f-c613-4521-ab9d-d4e3ac6c99fd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.225780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3061d8f-28f4-46f3-af1c-f9d1b4972c36 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.234543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.235217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.235495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.235769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.236519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.236824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.238487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0178d-f6e5-4c3d-b66d-8b89098d0ccd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.246961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 278/567] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.248225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb22182-23f9-47d2-8098-6ddd55ab718f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.248515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb22182-23f9-47d2-8098-6ddd55ab718f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.248795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb22182-23f9-47d2-8098-6ddd55ab718f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.250068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 279/568] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:41.250756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb22182-23f9-47d2-8098-6ddd55ab718f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.265772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.266475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.266753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.267025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.267766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.268094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.269447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.277690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 290/569] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.278506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.351061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb22182-23f9-47d2-8098-6ddd55ab718f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.373164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8e2eb-abc0-4de3-b295-6e912ee2f462 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.384304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.385086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.385365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.385636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.395343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.396789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.405353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.406178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.406460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.406735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.413253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:41.413724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:41.414799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:41.415954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:41.415954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:41.415954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:41.415954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:41.416186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.416256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 280/570] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:41.416256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-0600181d-4fa2-4df9-8235-f732afa97baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:41.434078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:41.435165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 291/571] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.436765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.437364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.453655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:41.454789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:41.519476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81760e2d-2b83-4716-9f7c-95f5b1836cb6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.521087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 292/572] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:41.521984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.552703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.553495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.553776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.554084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.565146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.566629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:41.584089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:41.585039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:41.585985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:41.585985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:41.585985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:41.585985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:41.585985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 281/573] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:41.586347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.621151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f549-d959-4b1d-968e-bd58e29a8d14 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.654192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.654989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.655270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.655546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.665164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.666631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:41.683702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:41.684772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:41.685696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:41.685696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:41.685696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:41.685696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:41.685960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606dec9-7b8c-44a3-8f68-74333c76ca99 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.689542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 293/574] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:41.690286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.720106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.720671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.721072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.721072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.721072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.721072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.723696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.737487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 282/575] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.738617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.788559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540dabb-d3e6-44fd-b237-a4946b44774c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.824077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.824845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.825130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.825409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.826231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.826543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.827970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.835710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823e44-a2a9-4e09-b8b7-45feb7a3c8f3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.840539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 294/576] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.841381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.870097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.871787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.872075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.872351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.882488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:41.894619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:41.895626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:41.896475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 283/577] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:41.897203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:41.946874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3551-90d4-44c7-b005-994e83a06bb9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:41.980441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:41.981023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:41.981304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:41.981573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:41.982324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:41.982628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:41.983986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:41.995026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 295/578] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:41.995965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.004242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c900d8-d31e-4370-91ac-a4ecc7ae76bd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.036932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755c14-4501-4818-9128-12d289decb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.037585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755c14-4501-4818-9128-12d289decb9c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.037890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755c14-4501-4818-9128-12d289decb9c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.038163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755c14-4501-4818-9128-12d289decb9c None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.038933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755c14-4501-4818-9128-12d289decb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.039181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755c14-4501-4818-9128-12d289decb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.040541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755c14-4501-4818-9128-12d289decb9c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.051968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 284/579] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:42.052787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755c14-4501-4818-9128-12d289decb9c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.092705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf5e6d-5120-48d2-8481-55834694d4df None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.126418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.127208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.127490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.127762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.134263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.135697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.152916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755c14-4501-4818-9128-12d289decb9c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:42.156691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:42.157743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 296/580] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:42.163336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.192154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.192905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.193266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.193545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.194451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=3e8d13580356499dafd5a8eaa7b14d4f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.194765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.196184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.202363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 285/581] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/role_assignments?user.id=3e8d13580356499dafd5a8eaa7b14d4f&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:42.203154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.270401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0dd4f-80df-4c97-988d-0a60b12d93fd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.306024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.306706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.306984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.307255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.308642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.308946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.310376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.313285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b56ced-6601-459f-a76d-1a4dbcdf4a4f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.323966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 297/582] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:42.323966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.348747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.349731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.350168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.350548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.359820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.361461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:42.378288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:42.379521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 18:13:42.380689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:42.387806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 286/583] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:42.387806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.428523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394aafd-1517-4b3d-b119-f0c8081f8fbf None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.463393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.464800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.465377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.465465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.475643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.475643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.489736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4149-ce3b-4b62-aa8c-4a9cc70b0978 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:42.495800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:42.496805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 298/584] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:42.497980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.525346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.525964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.526251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.527088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.528040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.528352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.529781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.542721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 287/585] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:42.543565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.601228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59136e95-9175-4ab8-8adb-ad11d0e14cb5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.634607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.635492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.635716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.636489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.647692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.649145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.653029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8110-34dc-48f3-b5d9-b8f32ef0969a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:42.666824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:42.668084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:42.673925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:42.673925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:42.673925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:42.673925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:42.673925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 299/586] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:42.673925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.694603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.695380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.695758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.696047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.696893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.697206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.699259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.716837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 288/587] 10.222.0.84 () {56 vars in 1137 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:42.718049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.772043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba44c1-1ba9-485e-babc-f4278f912b84 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.806419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.807124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.807383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.807679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.808551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.808861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.810328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.817434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8c05-dbdc-43e9-80f7-fd10da9bcbc7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.832393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 300/588] 10.222.0.84 () {56 vars in 1137 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:42.832393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.851542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.852425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.852701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.852969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/b5e358b1f53b408f8f1e9661ac754c39/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.868334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=b5e358b1f53b408f8f1e9661ac754c39, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.869815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:42.883252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 289/589] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:13:42 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/b5e358b1f53b408f8f1e9661ac754c39/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:42.884081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:42.951688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91b8a0-9aaf-4278-8c4d-cd30e78eca71 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.991328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:42.992419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:42.992652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f7ba-495a-4ea7-acb4-a0af3f6a0fa1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:42.993149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:42.993641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:42.994666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:42.996079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:42.997845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.016062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 301/590] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:43.017375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.032394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.033508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.033819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.034118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.048465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.050423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:43.074188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:43.075121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:43.076062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:43.076062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:43.076062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:43.076062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:43.078452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 290/591] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:43.079664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.158213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250bfd4-0fa6-4b62-abb6-e04ab432ee98 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.191455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.192255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.192534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.192805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.196658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db517-29f0-4160-9522-776803adc42f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.204604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.206158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:43.224219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:43.225158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:43.226375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:43.226375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:43.226375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:43.226375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:43.226375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 302/592] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:43.231041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.234836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.235644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.235930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.237027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.244504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.246728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:43.261983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:43.263078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:43.264008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 291/593] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:43.264602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.340385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148b10-c994-4af7-8ca5-1ad989929bf3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.368699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988327d-2816-4357-b8b1-51634e02aac4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.376881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.377850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.378372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.378858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.379855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:43.380372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.382231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.395731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 303/594] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:43.396859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.410552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.411280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.411680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.412029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.412835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:43.413290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.414738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.431422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 292/595] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:43.432484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.508222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237edef-3f5e-447e-9682-9ce0f86ad3e1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.542573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.543407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.543785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.544179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.545104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:43.545485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.547015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.559281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5248b4-10b0-4af3-a346-93b202431bcc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.566729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 304/596] 10.222.0.84 () {56 vars in 1139 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:43.567728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.603899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.605057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.605593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.606082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.615816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.617825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:43.637790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:43.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:43.639657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:43.646374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 293/597] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:43.647014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.688818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c625a-861d-49e7-b231-621d229b3158 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.726509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.727873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.728411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.728915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.736845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.738996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:43.755570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:43.756512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:43.757387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:43.757842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef14db6-b973-4d7a-a6bb-bd5d8b935953 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.764655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 305/598] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:43.765849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.791588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.793007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.793284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.793559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.804203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.805675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:43.825272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:43.826284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:43.827190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:43.827190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:43.827190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:43.827190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:43.827190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 294/599] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:43.827478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.878545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a435e-f0cc-4c69-87a8-e36dbce91948 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.914089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.915126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.915657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.916179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.917315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:43.917868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.919509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.929183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce8ca0-4318-43dc-8b0c-b3ac226e5862 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:43.934104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 306/600] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:43.939809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:43.967385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:43.967785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:43.968065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:43.968331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:43.969455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:43.969892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:43.971338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:43.988313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 295/601] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:43.988313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:44.051908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa58fa-4a25-4e92-bac7-f3e9c6f5282f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.087200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49c92-db66-4e30-ad07-de912b7a52d6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.090952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.091893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.092400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.092897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.093859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:44.094373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:44.096045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:44.109126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 307/602] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:44.110305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:44.122589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.123393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.123662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.123936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/7bd83f55b1a84d1894d19a505bcc18c0/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.142786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=7bd83f55b1a84d1894d19a505bcc18c0, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:44.144013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:44.167850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 296/603] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:13:43 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/7bd83f55b1a84d1894d19a505bcc18c0/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:44.167850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:44.332797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd45f-478f-46d1-bc60-fe6dbd87cb0d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.341108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6266-5fa4-4bd1-b1d9-b33f7648ece1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.374358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.375328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.375611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.375881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.385138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:44.387514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:44.398262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.399100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.399385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.399665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/a50eb00b59c3432bb7c085d3d8287ea4/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:44.405094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:44.406083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:44.407012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 297/604] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:44.413908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:44.539039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa824a-d713-413b-9a86-3e633799b448 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.551580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=a50eb00b59c3432bb7c085d3d8287ea4, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:44.553037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:44.570717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 308/605] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:13:44 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/a50eb00b59c3432bb7c085d3d8287ea4/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:44.583732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.584470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.584757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.585101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.585994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:44.586437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:44.587891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b913efa-3c39-45ec-9e43-5a35daa4770d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:44.609213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 298/606] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:44.611001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:44.661943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9261d-5111-4c31-be5d-7dae281a3863 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.662240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9261d-5111-4c31-be5d-7dae281a3863 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.662446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9261d-5111-4c31-be5d-7dae281a3863 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.664955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 299/607] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:13:44.673048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.673393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.673612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.696530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:44.701843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:44.772716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49907584-beed-4da1-9ea1-a1e69b69ee18 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.781629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 300/608] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:44.815468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.816379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.816671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.816933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/5b6ddbd6cd3f4f238fb1a23a04a99401/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:44.818808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:44.833388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=5b6ddbd6cd3f4f238fb1a23a04a99401, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:44.834908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:44.850716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 309/609] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:13:44 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/5b6ddbd6cd3f4f238fb1a23a04a99401/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:44.952093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f0ab-4330-40a0-8b6c-8275b9d95b8d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:44.990538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:44.991344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:44.991619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:44.991889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.004096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:45.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:45.014438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:45.015290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:45.018225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 301/610] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:45.024547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.136082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276190e5-185f-4b9a-89dd-5b8976e932a3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:45.173670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:45.174375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.174658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.174935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:45.175995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:45.177373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1057-4e56-4c89-a06f-795dce713bce None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:45.186588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 310/611] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:45.192288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.265878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4e285-d340-49ca-8059-9b85a96fac1a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.266069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4e285-d340-49ca-8059-9b85a96fac1a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.266353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4e285-d340-49ca-8059-9b85a96fac1a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.268093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 311/612] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:45.279520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.279847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.280133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.313987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:45.315185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:45.338605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571ac7-1a82-4a81-bde8-6c78321eda53 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:45.373500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:45.374706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.375193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.375664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.387472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:45.389283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:45.407444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:45.408401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:45.409312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:45.409312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:45.409312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:45.409312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:45.411571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 302/613] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:45.421331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.435657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 312/614] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:45.479993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.533154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78268def-8287-464f-a6ad-eac7f0b1f5cf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:45.567499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:45.568664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.569149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.569624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.570563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:45.571067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:45.572656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:45.585620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 303/615] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:45.595291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.654700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573d9e-37d5-42a8-8da8-dd948d558859 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:45.716555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:45.717685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.718129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.718614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.743186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:45.759682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:45.760747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:45.762262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:45.768727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461152-7df3-404a-be41-968ffb70f15a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:45.770655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 313/616] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:45.775920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.841648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:45.842907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:45.843402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:45.843876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:45.861819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:45.861819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:45.880355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:45.881345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:45.882314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:45.892927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 304/617] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:45.893855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:45.966057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb56f6-e94e-4f92-8c81-9b570b09d11a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.006758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.007434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.007714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.007993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.008746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:46.009049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.010452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.032104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 314/618] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:46.038067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.123774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2def48-4b4d-43ba-bf5f-e35fd79d5084 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.159866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69d82-2b4d-44d8-9183-30a3953ba92e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.203639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.204454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.204734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.205007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.211433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.212107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.212389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.212662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.213507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:46.214577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.216495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.235162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.236642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.240750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 305/619] 10.222.0.84 () {56 vars in 1135 bytes} [Fri May 13 18:13:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:46.246402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:46.269971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:46.270912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:46.271807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:46.271807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:46.271807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:46.271807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:46.272442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 315/620] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:46.281579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.426213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd5f0-a756-4e7e-bbcb-0445fec3bed2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.462813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93fa0-fadc-4c08-b25e-fae77730ba8e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.491384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.492181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.492464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.492738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.504305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.505774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:46.533502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:46.534481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:46.535365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:46.535365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:46.535365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:46.535365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:46.536253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 306/621] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:46.541824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.545322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.546037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.546326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.546607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.547347 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:46.547658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.549043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.573878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 316/622] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:46.579538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.680480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175011-b59c-4c69-a799-04ea4356c1c6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.716661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.717458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.717746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.718058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.725423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.727228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:46.743441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:46.746143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:46.748326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 317/623] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:46.754509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.775947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89e95b-bafd-4a99-96f4-d5c8f8e4f9c2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.870766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b667-7443-461b-94b0-74def59f3a94 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:46.882516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.883192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.883472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.883747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.884475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:46.884780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.886810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.909891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:46.910575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:46.910863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:46.911140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:46.911992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:46.912303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:46.913732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:46.916298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 307/624] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:46.926873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:46.938468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 318/625] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:46.944452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.061298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803787-1059-45be-9d5d-c89c659fbaa8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.106152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.107402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.107690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.107968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.117756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:47.119244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:47.119842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dc72e-2686-4455-9fe9-fda44b470d84 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c222be57-7d56-4fd9-bbdd-d5fa448a7e6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:47.138508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:47.139973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:47.141083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:47.143720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 308/626] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:47.148691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5f2a-2661-48e5-be81-b4b9640ba216 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.148691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5f2a-2661-48e5-be81-b4b9640ba216 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.148691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5f2a-2661-48e5-be81-b4b9640ba216 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.148971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 309/627] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:47.149557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5f2a-2661-48e5-be81-b4b9640ba216 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.167107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.168961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.169461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.169977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.258360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5f2a-2661-48e5-be81-b4b9640ba216 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.267495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:47.269811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:47.304762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.305874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.306387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.306898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.308188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:47.308716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:47.310389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91b698-0bc5-4492-aa45-9bef010afac5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:47.327642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 310/628] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:47.329449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.330066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.330555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.348749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:47.350329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:47.378619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 319/629] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:47.379619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.424964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 311/630] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:47.426212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.493397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a39d1-5e3a-457e-bc88-e6d21299ca8c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.528213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0bf46-4ffc-462c-befe-6d45f1ebb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.529022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bf46-4ffc-462c-befe-6d45f1ebb2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.529302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bf46-4ffc-462c-befe-6d45f1ebb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.529597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bf46-4ffc-462c-befe-6d45f1ebb2f7 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/3e8d13580356499dafd5a8eaa7b14d4f/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.533318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087638d2-2028-4d60-a315-eef5b111a4e2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.543736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0bf46-4ffc-462c-befe-6d45f1ebb2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=3e8d13580356499dafd5a8eaa7b14d4f, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:47.545216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0bf46-4ffc-462c-befe-6d45f1ebb2f7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:47.559621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 320/631] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:13:47 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/3e8d13580356499dafd5a8eaa7b14d4f/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:13:47.561296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26987dd-301d-4680-a270-ee1881b02684 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.561592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26987dd-301d-4680-a270-ee1881b02684 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.561896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26987dd-301d-4680-a270-ee1881b02684 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.564259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 321/632] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:47.565108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26987dd-301d-4680-a270-ee1881b02684 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.572185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.573994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.574520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.575009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.588302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:47.590642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-255d1457-21c0-4ad0-ad25-e1135920f738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:47.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:47.611408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:47.612321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:47.612321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:47.612321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:47.612321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:47.612321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 312/633] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:47.613427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d68d-37eb-4260-aef0-f49eaa7996cb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.613427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d68d-37eb-4260-aef0-f49eaa7996cb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.613672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d68d-37eb-4260-aef0-f49eaa7996cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.631243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-efe1d68d-37eb-4260-aef0-f49eaa7996cb None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:47.632465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-efe1d68d-37eb-4260-aef0-f49eaa7996cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:47.700190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26987dd-301d-4680-a270-ee1881b02684 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.713001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 313/634] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:47.713001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b19c7f-c0a0-498a-ad94-416337d7e8bc None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.713001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b19c7f-c0a0-498a-ad94-416337d7e8bc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.713001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b19c7f-c0a0-498a-ad94-416337d7e8bc None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.713001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 314/635] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:47.721967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b19c7f-c0a0-498a-ad94-416337d7e8bc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.746171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b765de-c7ad-473c-9a66-1a91591dbb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.746970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b765de-c7ad-473c-9a66-1a91591dbb32 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.747247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b765de-c7ad-473c-9a66-1a91591dbb32 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.747515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b765de-c7ad-473c-9a66-1a91591dbb32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.760053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b765de-c7ad-473c-9a66-1a91591dbb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f8b765de-c7ad-473c-9a66-1a91591dbb32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:47.768853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:47.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:47.770782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 322/636] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:47.771504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.771572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.771845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.788833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:47.789959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:47.831817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b19c7f-c0a0-498a-ad94-416337d7e8bc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.867264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 323/637] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:47.867264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.883574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.884660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.885125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.885562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:47.887537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:47.887862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:47.889256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:47.908230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 315/638] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:47.908230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:47.961274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba6b2-8338-4caf-810e-4c4c7700e7ea None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:47.994378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:47.996003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:47.996273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:47.996617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.006748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:48.013584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463ddb-9e74-4e18-b906-e40d49df4557 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:48.015156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:48.016110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:48.016968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 324/639] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:48.017681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.054116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.058168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.058168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.058168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.058168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:48.058168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.058595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.070782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 316/640] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:48.070782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.126929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5326-a0de-4925-a333-b8d004bafec9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.161067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.161887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.162167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.162440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.171769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cac90-80ba-4365-90b4-e1d7d77b8465 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.174100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:48.181743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:48.183664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:48.184669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 325/641] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:48.185438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.222930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.223718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.223998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.224273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.231025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.232462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:48.247096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:48.248293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 317/642] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:48.249465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.297477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104d59a-d950-4786-9168-30ca2547bc40 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.332156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.333171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.333639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.333954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.334715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:48.335033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.336414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.345561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 326/643] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:48.350665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.355878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8c61a-0c82-4042-ae42-27eca108a460 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.395102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.395900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.396182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.396483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.407920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.409399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:48.427519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:48.428646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:48.429635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:48.429635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:48.429635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:48.429635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:48.429635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 318/644] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:48.429635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.457783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20dd2d-2c08-4cba-a266-fa518c34a306 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.497918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.498898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.499405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.499687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.500546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:48.500864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.502274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.515489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 327/645] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:48.515489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.540629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3f34-b78f-493b-8975-e562652edfea None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.576962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.577617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.577922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.578204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.578969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:48.579271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.580675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.594612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 319/646] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:48.595826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.614401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbff9-860d-460c-9e92-32f653d87989 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.647379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.648163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.648440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.648712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.660497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.661974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:48.690310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:48.691270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:48.692207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:48.692207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:48.692207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:48.692207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:48.692207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 328/647] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:48.692484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.716715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7fc2a-576f-4beb-82d5-89e56e66d03b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.752244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.752908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.753193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.753467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.754227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:48.754534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.755913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.767983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 320/648] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:48.769045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.795142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05c712-de3d-422b-bef1-fd337ce9adf8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.832138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.833198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.833667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.833994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.845645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.847080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:48.865328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:48.866478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:48.867483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:48.867483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:48.867483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:48.867483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:48.867483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 329/649] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:48.867788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.878449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7690d-c7b9-4480-8d45-38a44a7f6166 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:48.911513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:48.912161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:48.912448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:48.912713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:48.913532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=b5e358b1f53b408f8f1e9661ac754c39) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:48.913857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:48.915268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:48.922090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 321/650] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/role_assignments?user.id=b5e358b1f53b408f8f1e9661ac754c39&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:48.923158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:48.980628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97707f41-d7be-4a5b-88df-71986738d7c3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.018334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.019274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.019739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.020228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.021172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:49.021691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.023368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.029198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac5327-0ae4-4489-8a7e-e4aa137b7de8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.042362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 330/651] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:49.043663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.065417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.066252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.066531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.066804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.076123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.077628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:49.093255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:49.094585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:49.095593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 322/652] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:49.096256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.165849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fdb2-a799-4334-af54-ff5ccc219d2f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.204383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.205059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.205314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.205603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.206341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:49.206644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.208005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.209451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412c6fc-d68e-4245-afc9-bc9e9f6b17d7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.220514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 331/653] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:49.221180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.255429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.256236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.256519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.256797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.266181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.267637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:49.283908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:49.284906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:49.285917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 323/654] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:49.288017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.343133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c898-5af2-40a7-804e-b2388b6ea0a8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.379199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.379630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.379919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.380196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.381046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:49.381440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.382936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.403113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 332/655] 10.222.0.84 () {56 vars in 1137 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:49.404064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.422132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffaf96e-a7c4-4eb0-8d77-3dbe1dcb75a4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.463408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.465157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.465642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.465768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.473818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.475321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:49.493367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:49.494449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 18:13:49.496053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:49.498319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 324/656] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:49.498958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.528947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916b823-99e5-460d-9dd0-60106c95340b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.570271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.571118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.571467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.571813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.572916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:49.573316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.574846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.596159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 333/657] 10.222.0.84 () {56 vars in 1137 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:49.597758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.615046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1e9f9-0cd6-48ec-87ff-133c4ec1afcf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.654203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.655073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.655729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.656083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.717279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b377d-0f41-416c-96a3-bd44b3d6b780 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.738694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.740152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.754013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.754817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.755174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.755518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.756520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:49.756896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.758521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:49.779052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 334/658] 10.222.0.84 () {56 vars in 1139 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:49.780035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.851919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 325/659] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:49.852886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:49.886697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a53f-a8b2-4ec5-8107-cd112a97a598 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.923588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.924160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.924443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.924721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.956944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a547322-3f6b-4855-a065-fbc6d8fea605 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:49.993453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ace0f-b748-4b45-ad33-aba3148320c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:49.994141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ace0f-b748-4b45-ad33-aba3148320c5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:49.994418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ace0f-b748-4b45-ad33-aba3148320c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:49.994689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ace0f-b748-4b45-ad33-aba3148320c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:49.995404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:49.997017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.062355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ace0f-b748-4b45-ad33-aba3148320c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.063811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ace0f-b748-4b45-ad33-aba3148320c5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.095375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 335/660] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:50.096492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.170591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 326/661] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:50.172134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf23fc-9297-48ff-a167-454f7008617e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.172488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf23fc-9297-48ff-a167-454f7008617e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.172837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf23fc-9297-48ff-a167-454f7008617e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.178003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 327/662] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:50.178760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf23fc-9297-48ff-a167-454f7008617e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.201009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e682bd7-c02d-484b-84e5-ad4b772590c2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.235442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.236273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.236500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.236772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.249221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.251444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:50.275865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:50.276914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:50.277828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:50.277828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:50.277828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:50.277828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:50.281955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 336/663] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:50.282708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.291281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf23fc-9297-48ff-a167-454f7008617e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.330357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.331153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.331437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.331717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.343069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.344554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-05ee5281-ec27-4007-be37-cd19751e5af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:50.366581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:50.367556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:50.368450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:50.368450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:50.368450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:50.368450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:50.368450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 328/664] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:50.369207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.369311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.369521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.388781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b3da-2e68-4ded-adba-0aec88fa3298 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.388980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:50.390186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:50.422467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.423268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.423553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.423832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.435683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.437068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:50.455045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:50.456148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:50.461774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:50.461774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:50.461774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:50.461774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:50.461774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 337/665] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:50.462632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.464707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 329/666] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:50.465840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.568190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7a2c-080d-4c5b-b74e-dffa1a92a07f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.572122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa93f-b189-4921-9458-16ce760c19fc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.603924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.604935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.605121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.605412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.606182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:50.606456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.607283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.607828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.607932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.608206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.608475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.609202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:50.609489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.610877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.624765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 338/667] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:50.624765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.628464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 330/668] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:50.628464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.733656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c8e9a-819e-4225-a04b-8dba5aece6e3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.735878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4a5ee-0414-40e9-ae8a-99ba6a83837c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.768622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.769690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.770147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.770389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.770757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.771055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.771342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.771622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.772355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:50.772670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.774078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.782992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:50.787055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 339/669] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:50.788120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:50.790820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:50.791848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 331/670] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:50.798214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.894665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e74a7-a5ba-42a8-b369-ffd886ebec8f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.894995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7671c-0a40-4ca4-84a5-477b94902039 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:50.929037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.929267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:50.929866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.929994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:50.930156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.930250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:50.930425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.930521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:50.938258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.938447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:50.939777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.939885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:50.954137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:50.955077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:50.955966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:50.956408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:50.957211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:50.958140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:50.959991 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 340/671] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:50.960669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:50.961322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 332/672] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:50.962169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.062854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20460-880a-4be2-8f80-0dc7e1b514ed None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.063052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae475204-7918-414e-951f-a734e054c1ba None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.097878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.098525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.098803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.099072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.100760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.101428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.101707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.102015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.102758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.103061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.105029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.108034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.109601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.113673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 333/673] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.114737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:51.124052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:51.125168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:51.126302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 341/674] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:51.126789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.228966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9cc28-372c-4ecc-9644-1410597e594c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.233386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62611ce1-1938-4afb-97ca-8f026036df74 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.263884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.264967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.265382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.265645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.266341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.266487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.266625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.266904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.267693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.267802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.268003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.268376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.269434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.270136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.282191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 342/675] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.283023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.283845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 334/676] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.284732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.386709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9eee-d754-436c-bffc-3cc2e6d076b7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.390821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a98d7-1207-4af7-9de9-1720a1c68086 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.419590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.420255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.420544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.420817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.421600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.421938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.423363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.425295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.426129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.426413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.426738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.435469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 335/677] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.436317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.438153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.439721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:51.458337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:51.459309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:51.460214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:51.460214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:51.460214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:51.460214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:51.460214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 343/678] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:51.460528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.536485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7fb2-3ac1-48a1-af68-3220d8d0bef4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.558685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b6f45-99c6-4a4e-affb-f1226fc0b813 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.569693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.570375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.570658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.570938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.571768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=7bd83f55b1a84d1894d19a505bcc18c0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.572078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.574251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f497c-7a92-46ac-bcbd-76d7fa75c425 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.580323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 336/679] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/role_assignments?user.id=7bd83f55b1a84d1894d19a505bcc18c0&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.581566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ecbf-d623-4f29-a805-3771bea49936 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.581881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ecbf-d623-4f29-a805-3771bea49936 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.582163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ecbf-d623-4f29-a805-3771bea49936 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.583389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 337/680] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:51.584090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ecbf-d623-4f29-a805-3771bea49936 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.600538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.601221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.601499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.601763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.602652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=a50eb00b59c3432bb7c085d3d8287ea4) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.602963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.604971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.611884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 344/681] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/role_assignments?user.id=a50eb00b59c3432bb7c085d3d8287ea4&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.613046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.736517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fae6a-29fa-4339-aa2c-74828a3641b5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.750727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ecbf-d623-4f29-a805-3771bea49936 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.779462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.780529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.780999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.781458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.782424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.782922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.784569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d745-e06e-4299-a931-08b74a974b11 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.796540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.797273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.797754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.797939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.798849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=5b6ddbd6cd3f4f238fb1a23a04a99401) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:51.799165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:51.799911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 345/682] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.805906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.805906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.805906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:51.806261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:51.813907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 338/683] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/role_assignments?user.id=5b6ddbd6cd3f4f238fb1a23a04a99401&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:51.815971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.821035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:51.822366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:51.924025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 346/684] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:51.947185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08611f-882e-4495-975a-f0dbea1393c9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:51.952116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:51.995274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:51.997165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:51.997963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:51.998481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.008970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:52.012608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:52.034327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:52.035331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:52.036285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:52.039332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 339/685] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:52.045725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.085014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e665e-9298-4b18-9537-cd25d23eb3fe None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:52.134583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:52.136328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:52.136812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:52.137314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.148078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:52.156865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:52.157837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:52.158709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:52.161431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 347/686] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:52.167832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.173662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c54bd8-336d-458b-b012-b2c24c96ae70 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:52.217523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:52.218266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:52.218538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:52.218809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.219647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:52.219956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:52.221783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:52.245686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 340/687] 10.222.0.84 () {56 vars in 1135 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:52.254250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.293017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f509-f64c-4c06-8e50-01ef69947d32 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:52.331019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:52.331605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:52.331881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:52.332150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.332925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:52.333231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:52.334638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:52.351368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 348/688] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:52.358839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.391717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a156-9df9-47c3-81f7-4e472cd74e7b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:52.460531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:52.461185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:52.461463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:52.461734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.541482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a3ec0-d131-40de-a6ab-95dfeba1b84f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:52.599063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:52.600740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:52.602034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:52.602902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:52.603250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:52.603589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.616312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:52.617886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:52.644759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:52.645722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:52.647700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:52.647700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:52.647700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:52.647700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:52.647700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 349/689] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:52.651828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.733552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 341/690] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 18:13:52.739114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.798618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209dce5-68c6-41cc-b28a-0b95137606bb None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:52.833488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:52.834191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:52.834473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:52.834748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:52.835478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:52.835782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:52.837156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:52.850285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 350/691] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:52.861837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:52.957576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6101fa-4d7e-43e4-8b19-a8ec9aa9f647 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.001448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.002278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.002557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.002830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.018663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093094-ecca-4b53-a768-f7d33d7793b2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.021867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.023386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:53.054460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:53.055374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:53.056744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:53.056744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:53.056744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:53.056744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:53.057011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 342/692] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:53.062817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:53.064881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.066126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.066412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.066686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.086641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.088161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:53.112013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:53.114679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:53.116911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 351/693] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:13:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:53.129513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:53.182655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33a26-e1be-4a71-b2be-2709c62656be None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.217638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.218379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.218668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.218939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.219662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:53.219963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.221328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.233680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 343/694] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:53.239440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:53.264903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638ebb0-442e-4b0c-9fdb-54adbd703604 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.300360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.301128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.301291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.301569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.302447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:53.302756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.304168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.321972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 352/695] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:53.340424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:53.350181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6263e-d3d6-4d10-a6b4-c1793548fdf5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.389257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.390322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.390602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.390875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.406323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.407778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:53.441892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:53.443996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:53.446134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:53.447193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 344/696] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:53.450543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:53.548586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063d6a-4f54-4183-a8b9-413293a33293 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.557253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339574ec-4de6-44f6-b8f5-1cd29a4117c2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.605233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.606748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.607635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.608446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.610432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.611290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.611600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:53.612083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.612676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.613388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.615039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.638922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 345/697] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:53.645833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:53.737123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.738856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.789308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197e55-3f29-4724-bdd5-45fddd71cbf2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:53.863790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:53.864377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:53.864656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:53.864928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:53.865770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=3e8d13580356499dafd5a8eaa7b14d4f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:53.866098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:53.867813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:53.878478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 346/698] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/role_assignments?user.id=3e8d13580356499dafd5a8eaa7b14d4f&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:13:53.892463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 353/699] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:13:53.894215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.025271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657731-48dd-4808-a81d-38401af9dabb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.074702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.075916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.076416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.076884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.090729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.092584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:54.114571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:54.115519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:54.116417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:54.116417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:54.116417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:54.116417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:54.118462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 347/700] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:54.124768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.243198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7adc-f3a3-4396-bded-3a9adaaa2f36 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.282941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.283971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.284471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.284947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.285920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:54.286495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.288109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298985d4-2b09-4bd2-bd5a-7964cf13b9f9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.301570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 354/701] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:54.306658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.396978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf971-fd1c-4a7b-9ca4-686d42900cde None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.397578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf971-fd1c-4a7b-9ca4-686d42900cde None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.398094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf971-fd1c-4a7b-9ca4-686d42900cde None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.404340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 355/702] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:13:54.406258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.406770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.407266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.424183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c99b0-98fb-4f1d-92db-5c6c63d3d203 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.429037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:54.430285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:54.484934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.486236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.486783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.487258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.496981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.498858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:54.515634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:54.516594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:54.517490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:54.520144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 348/703] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:54.524464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 356/704] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:54.525302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.548323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.677224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f3a7-aefb-46d0-8d08-dc9fda24c0a0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.686584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b957-405b-4875-a8f2-526c2831b248 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.712092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.712758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.713045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.714029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.714993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:54.715297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.716730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34676-d4c1-456c-ad7c-51751a5ffd75 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.722077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.722941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.723225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.723807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.724146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.725566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.728632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 349/705] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:54.732416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9f78-5b56-4b5a-ade9-0f8fb354fb44 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.732416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9f78-5b56-4b5a-ade9-0f8fb354fb44 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.732416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9f78-5b56-4b5a-ade9-0f8fb354fb44 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.732701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 350/706] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:54.733586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afc16-961d-447d-83db-c064c7059cfd None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.737003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afc16-961d-447d-83db-c064c7059cfd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.737003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afc16-961d-447d-83db-c064c7059cfd None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.738077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 351/707] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:54.738648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afc16-961d-447d-83db-c064c7059cfd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-90a3b5cd-aaa6-4b12-b96e-cb021afa6b90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:54.740545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:54.741503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:54.742382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 357/708] 10.222.0.84 () {56 vars in 1129 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:54.743219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.743219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.744062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.761321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:54.762740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:54.831946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 358/709] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:54.832838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:54.864209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afc16-961d-447d-83db-c064c7059cfd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.900298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977957a-0781-4958-9593-0611e043a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.901092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977957a-0781-4958-9593-0611e043a85d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.901444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977957a-0781-4958-9593-0611e043a85d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.901988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977957a-0781-4958-9593-0611e043a85d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.902837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977957a-0781-4958-9593-0611e043a85d None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=b5e358b1f53b408f8f1e9661ac754c39) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:54.903203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977957a-0781-4958-9593-0611e043a85d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.904642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977957a-0781-4958-9593-0611e043a85d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.918152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 352/710] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/role_assignments?user.id=b5e358b1f53b408f8f1e9661ac754c39&scope.project.id=31dac20388d84281bab425701bac98be&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:54.918152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.918152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.918152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.936995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:54.936995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:54.941504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c59895-ae55-4062-a0c0-11391c27d5af None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:54.981528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:54.982255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:54.982538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:54.982816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:54.983552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:54.983867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:54.985281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:54.996477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 359/711] 10.222.0.84 () {56 vars in 1124 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:54.997337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.022125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 353/712] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:55.023472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.117833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296e1e-7c37-4150-b507-f655989c2b8c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.146222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.147050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.147534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.148034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.149476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb70a3-bc57-438c-b365-5e79c9d5480e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.163177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.164650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.187700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.188307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.188589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:55.188811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:55.189748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:55.190691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:55.190691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:55.190691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:55.190691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:55.190932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.190932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:55.190932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.191377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.193904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 360/713] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:55.194785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.200753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 354/714] 10.222.0.84 () {56 vars in 1124 bytes} [Fri May 13 18:13:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:55.201588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.361195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4644-09f4-4ba3-81ec-8c706087a76c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.416349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.417921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.418211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.418537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] PATH_INFO: `/v3/services/network` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.419247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.420685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:55.446111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:55.449084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:55.451183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 361/715] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:55 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:55.463868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.554133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870f8e-d1d6-4257-86a2-d17dc10595fa None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.591509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab2917-7437-4794-919b-572837f38821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.592179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2917-7437-4794-919b-572837f38821 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.592461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2917-7437-4794-919b-572837f38821 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.592738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2917-7437-4794-919b-572837f38821 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.593466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab2917-7437-4794-919b-572837f38821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:55.593769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab2917-7437-4794-919b-572837f38821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.595184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab2917-7437-4794-919b-572837f38821 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.609860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 355/716] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:55.616795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab2917-7437-4794-919b-572837f38821 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.638315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660673-7501-4ea6-b1bb-4b55e3cff556 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.683622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.684596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.684869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.685592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] RBAC: Adding query filter params (name=network) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:55.685927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.687310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.702481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 362/717] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:13:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:55.708130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:55.836287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b010765-a7ca-497c-8a61-a7f2818f0d6c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.856016 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab2917-7437-4794-919b-572837f38821 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:55.881511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.882217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.882501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.882780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.883507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] RBAC: Adding query filter params (type=network) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:55.883816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.885778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47736-e0ea-41e7-a5d1-f4e23a672ed5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.896895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 363/718] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:13:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:55.922727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d0ad-9b39-4e86-97cb-6d4e31e73b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:55.923436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d0ad-9b39-4e86-97cb-6d4e31e73b1a None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:55.923718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d0ad-9b39-4e86-97cb-6d4e31e73b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:55.924002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d0ad-9b39-4e86-97cb-6d4e31e73b1a None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:55.924726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4d0ad-9b39-4e86-97cb-6d4e31e73b1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:55.926243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4d0ad-9b39-4e86-97cb-6d4e31e73b1a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:55.960817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 356/719] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:13:55 2022] POST /identity/v3/users => generated 254 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:56.746058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb28d1b-1dc3-4f39-8584-3045bd400a59 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:56.746545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb28d1b-1dc3-4f39-8584-3045bd400a59 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:56.746545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb28d1b-1dc3-4f39-8584-3045bd400a59 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:56.748171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 364/720] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:56.753614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:56.754117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:56.754194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:56.777820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:56.779020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:56.857879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 357/721] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:56.881230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb28d1b-1dc3-4f39-8584-3045bd400a59 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:56.986706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb28d1b-1dc3-4f39-8584-3045bd400a59 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:57.022987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:57.023697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.023977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.024251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.035008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:57.043755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:57.045926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:57.048034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 365/722] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:57.053821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:57.151665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed46cc8-91d0-453d-a771-e43992e0051a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:57.198716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:57.199437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.199722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.200001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.200753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:57.201055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:57.202451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:57.211099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 358/723] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:57.216763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:57.348514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36b9a-2956-4a81-a62c-8c935068fea5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:57.399039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:57.399836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.400115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.400386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.413782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:57.415251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:57.437149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:57.439402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:57.441519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:57.441519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:57.441519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:57.441519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:57.441519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 366/724] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:57.444013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:57.586422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4fbd-5847-465b-8260-720ec84e020d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:57.621016 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:57.621601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.621907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.622188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.622917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:57.623224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:57.624890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2479d-3b11-474b-ad83-1d9b866a0018 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:57.636980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 359/725] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:57.642091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:57.752146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4038-286a-42ce-b82d-ead4ff27131b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.752502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4038-286a-42ce-b82d-ead4ff27131b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.752702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4038-286a-42ce-b82d-ead4ff27131b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.754396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 360/726] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:13:57.759450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.759733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.760012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.784069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:57.785249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:57.810212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c1117-9a3f-4c2c-9e9a-fd0880ae1d1b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:57.853034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:57.853901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:57.854188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:57.854461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:57.873096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:57.874502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:57.900485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:57.903606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:57.904787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 367/727] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:57.911039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:57.930169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 361/728] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 18:13:57.947091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.048205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9162-fa6e-440a-b45b-216cf17ae663 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.084423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.085236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.085526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.085818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.098828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:58.106972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:58.109263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:13:58.111359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:58.117849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 362/729] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:13:58.119141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.132805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf259-6b61-4629-ab50-54bf9c0ce0e1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.179690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.180378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.180662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.180937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.181806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:58.182687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.184178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.223484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 368/730] 10.222.0.84 () {56 vars in 1135 bytes} [Fri May 13 18:13:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:58.228924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.311710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdefe6-fb56-4676-9504-51abb40b5bc8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.353433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.354821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.355242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.355691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.356833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:58.357149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.359002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851c30-eb43-435a-bfe2-6ad1343c13d5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.371288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 363/731] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:58.373382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1718-2391-40eb-a69f-f61068c6b5f0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.373674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1718-2391-40eb-a69f-f61068c6b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.373981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1718-2391-40eb-a69f-f61068c6b5f0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.375007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ee0c-5e9d-492a-80ca-fd365e98c5e9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.377886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 364/732] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:58.378888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1718-2391-40eb-a69f-f61068c6b5f0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.415885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.417007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.417333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.417613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.489963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.491490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.504470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1718-2391-40eb-a69f-f61068c6b5f0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.539750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.540543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.540826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.541100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.552518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.554025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c2387365-3db5-450d-aa7c-468fb7d597b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:58.573613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:58.574594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:58.575921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:58.575921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:58.575921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:58.575921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:58.575921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 365/733] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:58.577322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.577322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.577322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.594182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:58.595369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:58.597959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 369/734] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 18:13:58.598966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.667490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 366/735] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:58.668314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.707646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c571-6ff3-49ba-93e0-9c2025d3ea58 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.742153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.742815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.743088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.743355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.744069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:58.744411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.746033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666c05-479b-421a-8652-7ce3328ec180 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.756875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 370/736] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:58.759171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353473c-4393-44a7-87c2-c6b38e4a103a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.759459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353473c-4393-44a7-87c2-c6b38e4a103a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.759736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353473c-4393-44a7-87c2-c6b38e4a103a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.761764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 371/737] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:58.762454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353473c-4393-44a7-87c2-c6b38e4a103a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.785037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e25e42-a05f-4f4d-aabc-e6853f64995d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.820161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.820959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.821243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.821523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.832291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.833737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:58.851889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:58.852914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:58.854307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:58.854307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:58.854307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:58.854307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:58.854307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 367/738] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:58.854589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:58.872821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353473c-4393-44a7-87c2-c6b38e4a103a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:58.910317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ee947-c719-45d4-ac05-2bfd07e11f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:58.911000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ee947-c719-45d4-ac05-2bfd07e11f1d None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.911286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ee947-c719-45d4-ac05-2bfd07e11f1d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.911564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ee947-c719-45d4-ac05-2bfd07e11f1d None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.912302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ee947-c719-45d4-ac05-2bfd07e11f1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:58.913696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ee947-c719-45d4-ac05-2bfd07e11f1d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:58.929243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 372/739] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:13:58 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:58.930547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:58.930837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:58.931124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:58.952704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:58.953957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:58.972427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4c0a-a37c-4597-9ac9-6323a15aeb54 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.020092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.021304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.021816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.022327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.032196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.034068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.038305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 373/740] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 18:13:59.039335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:13:59.051191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:59.052248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:13:59.053213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:59.055953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 368/741] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:13:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:59.064048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.158652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf60db-92d5-4b6f-9a7b-9570440a5354 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.181077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c045ad-ca82-4fd4-a39c-ef8bb36a7eee None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.194902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.195568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.195850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.196129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.196858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:59.197171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.199235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.210747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 374/742] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:59.211424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.214260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.214932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.215217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.215490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.216363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:59.216666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.218094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4efba-9365-4136-a4bb-c9ecbc5cbbfc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.240916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 369/743] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:59.240916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce9a3-f628-47fd-89cc-174d75e016b4 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.240916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce9a3-f628-47fd-89cc-174d75e016b4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.240916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce9a3-f628-47fd-89cc-174d75e016b4 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.240916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 370/744] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:13:59.240916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce9a3-f628-47fd-89cc-174d75e016b4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.320357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b002a0-f32b-41b3-841f-2acafa418ef3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.347306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce9a3-f628-47fd-89cc-174d75e016b4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.363888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.364670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.364951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.365222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.366088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.367503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.390053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 375/745] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:13:59 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:13:59.390053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.405536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.406587 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.406874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.407523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.417881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.420272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-552d165f-23d4-4399-9234-6d4e5f59f14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:13:59.440744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:59.441675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:13:59.442603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:13:59.443035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 371/746] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:59.444002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.444287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.444565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.467814 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:13:59.469220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:13:59.520416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7e182-d63c-42c9-b4e8-f0d5d39f0683 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.558783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 372/747] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:13:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:13:59.559983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.569013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.569894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.570182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.570462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.594515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.595989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:13:59.616534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:59.618208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:59.619203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:13:59.619203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:13:59.619203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:13:59.619203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:59.619203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 376/748] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:59.619203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.681147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e96c9-4807-489a-ba3b-7f506b33ed12 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.724684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.725580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.726061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.726481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.727415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:59.727868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.730180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.738094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627cc2d-9589-4430-a2ef-135fbbd5dfa1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.742789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 373/749] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:59.743892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.785738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.786657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.786953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.787404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.801328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:13:59.812093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:13:59.813410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 377/750] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:13:59.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.863973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af59ad-66b8-4509-b54c-499975b7ca8b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.899813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.900932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.901623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.902136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.903088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:59.903617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.905190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.918734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 374/751] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:59.919962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:13:59.940694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f428d-0134-4c61-af37-36e26073071f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:13:59.981238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:13:59.982586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:13:59.983262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:13:59.983778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:13:59.984851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=3e8d13580356499dafd5a8eaa7b14d4f) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:13:59.985388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:13:59.987167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:13:59.996286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 378/752] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/role_assignments?user.id=3e8d13580356499dafd5a8eaa7b14d4f&scope.project.id=31dac20388d84281bab425701bac98be&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:13:59.997589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:00.033646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11746a4b-2ff1-4fab-9fac-14fca99cfdaf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.070458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.071139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.071423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.071699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.073023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:00.073458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.074767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.083687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 375/753] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:00.090933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:00.110282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7998f3-3f00-4f4c-9313-c14bf26fe3db None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.148164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.149293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.149460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.149850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.157784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.159435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:00.175687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:00.176716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:00.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 379/754] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:00.183791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:00.223599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b0350-c523-419c-abf4-d3d2058228fd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.259075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.260816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.261375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.261919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.273143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.274902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.293644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1fe6a-512c-4df3-94e2-743017abdae4 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:00.295217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:00.296095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:00.297026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:00.297026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:00.297026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:00.297026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:00.299316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 376/755] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:00.306778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:00.397602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.397602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.397602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.397602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.398045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:00.398045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.398426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.429827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 380/756] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:00.435996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:00.537900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cee73-a3a5-4b63-98d7-85b8b001db3c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.617789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.618859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.619919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.620402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.621365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:00.621902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.633822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.669821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 377/757] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:00.675262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:00.811935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc56d0-fe38-4841-b925-e8b671d14b32 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.907342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b04c7-2962-4f36-a0fb-2beaaf99e8d0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:00.918610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.919538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.919820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.920095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/b5e358b1f53b408f8f1e9661ac754c39/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.926724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=b5e358b1f53b408f8f1e9661ac754c39, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.928184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.948891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 381/758] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:00 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/b5e358b1f53b408f8f1e9661ac754c39/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:14:00.950101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:00.951212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:00.951703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:00.952179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:00.960802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:00.962703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:00.980837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:00.981898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:00.982869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:00.985551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 378/759] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:14:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:00.992091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:01.102105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b1fb-08c0-4f60-ada2-345fd31207b7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:01.138942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:01.139678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:01.139964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:01.140242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:01.141087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:01.141403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:01.142848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:01.170476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 382/760] 10.222.0.84 () {56 vars in 1149 bytes} [Fri May 13 18:14:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:01.176149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:01.332082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a36fc-5fdf-43c9-89b0-020503f15215 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:01.368072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:01.368652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:01.368933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:01.369225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:01.465240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:01.466820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:01.591132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 379/761] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:01.596510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:01.752122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab6208-c6b4-4436-855a-29cee6a291c2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:01.799123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:01.799998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:01.800276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:01.800551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:01.823871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:01.825534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b5a75901-5651-4ae8-8eb2-f42955e92eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:01.845842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:01.847970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:01.850032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:01.850032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:01.850032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:01.850032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:01.850032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 383/762] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:01.853703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:01.888610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335630b-323a-4ffa-b174-d0fc20e9543b None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:01.888927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335630b-323a-4ffa-b174-d0fc20e9543b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:01.889156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335630b-323a-4ffa-b174-d0fc20e9543b None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:01.890848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 384/763] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:01.903973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:01.904297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:01.904515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:01.922375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:01.923572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:01.964196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7af1a-1eb2-4afc-a6a2-0c8c67e9144f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.012463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.013052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.013330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.013602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.015266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:02.015624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.017901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.030658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 380/765] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:02.030952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 385/765] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:02.035986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.108425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.167137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e327-4b6e-4cb9-85ef-b9321a73d1d7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.204035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.204856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.205137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.205415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.215330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.217147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:02.235228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:02.236219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:02.237137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 386/766] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:02.243523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.307617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb291bc-4d22-4fc8-abb9-121949e2e3a5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.347212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.348265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.348713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.349128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.349950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.351452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-70f987e4-b2a2-4d24-9930-81419f8eb630 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:02.366528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:02.367696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:14:02.368644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:02.371931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 381/767] 10.222.0.84 () {56 vars in 1129 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:02.373318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e646-2b81-4251-ad60-beb6368b2f0a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.373629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aa7d-e45b-445f-895a-291d81d112e4 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.373942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e646-2b81-4251-ad60-beb6368b2f0a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.374346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e646-2b81-4251-ad60-beb6368b2f0a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.376067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 382/768] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:02.381846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e646-2b81-4251-ad60-beb6368b2f0a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.414816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.415486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.415770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.416077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.417034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:02.417345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.418818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9774378-41fe-4022-b8cd-e3258b0498a8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.431524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 387/769] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:02.432876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.433164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.433442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.454978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:02.456178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:02.486783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e646-2b81-4251-ad60-beb6368b2f0a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.534895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.535578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.535866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.536197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.536926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:02.537234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.538958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.540545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 388/770] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:02.542843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.553518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 383/771] 10.222.0.84 () {56 vars in 1124 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:02.566812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.658053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bcab0-640e-4562-a41d-b0d3f8ca1ea8 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.680323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fc7b3-059e-404a-ad5e-3c12842fbf25 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.695017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.695681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.695966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.696245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.697094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=31f30b58e64c45beb61a9ec51c9526da) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:02.698596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.700231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.706169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 389/772] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/role_assignments?user.id=31f30b58e64c45beb61a9ec51c9526da&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:02.706980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.718683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.719707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.720247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.720757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.721739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:02.722291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.723925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296cec1-3d1c-4dfd-b549-8c83fa2419af None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.730534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 384/773] 10.222.0.84 () {56 vars in 1124 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:02.732313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e2b43-5e46-436d-853d-2419cdacb863 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.732862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e2b43-5e46-436d-853d-2419cdacb863 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.733362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e2b43-5e46-436d-853d-2419cdacb863 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.735311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 385/774] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:02.736391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e2b43-5e46-436d-853d-2419cdacb863 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:02.831378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c703ca8-f8f5-4d11-9f28-ac1ec07a6228 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.860537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e2b43-5e46-436d-853d-2419cdacb863 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:02.867912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.868729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.869011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.869854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] PATH_INFO: `/v3/services/network` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.870528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.871950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-be29d289-9492-4dd9-bad7-e268599c6080 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:02.889048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:02.890205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:02.891061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 390/775] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:02.896895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.896895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.896895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.911342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:02.912295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:02.912729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:02.913153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:02.914131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] RBAC: Adding query filter params (interface=public, service_id=23879767363b43fc9b3b3b4b61fd110a, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:02.914601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:02.916333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:02.919139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:02.919267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:02.927953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 386/776] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/endpoints?service_id=23879767363b43fc9b3b3b4b61fd110a&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:02.929994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.017902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 391/777] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:03.018849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.039372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f6e04-ae2e-4869-84c0-dbcd325957c3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.076511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.076902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.077189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.077467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.078212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] RBAC: Adding query filter params (name=network) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:03.078543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.079929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.084981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 387/778] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:03.085738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.134285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4c3e-8514-4b4c-8874-21d28d6185b2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.170660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.171713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.172200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.172676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.173568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.175157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.185955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 392/779] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:03.187278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.201832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62897d78-73c6-4f02-8dff-5019886310cc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.233169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.235436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.235718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.235994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.264481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:03.272393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:03.273434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:03.274753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 388/780] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:03.290898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.339106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82e7b-99af-49b1-a274-8fecb2672f4d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.382625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.383708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.386272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.386832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.387796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] RBAC: Adding query filter params (type=network) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:03.390435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.392256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.406233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 393/781] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:03.411572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.499243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc8564-617f-4cde-a65b-f7ab61ff19a3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.540298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.542063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.542686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.543173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.544231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:03.544809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.546520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.561905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 389/782] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:03.563958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.575341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfef84-a055-44b9-874e-e282d6d970e0 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.615897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.616516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.616804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.617083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.618246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] RBAC: Adding query filter params (interface=public, service_id=0090b8017a224b5e8e87ebb0f6301df5, region_id=RegionOne) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:03.618246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.620550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.631667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 394/783] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/endpoints?service_id=0090b8017a224b5e8e87ebb0f6301df5&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:03.637602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.709389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764080bc-eb39-412d-b89c-ad33b0eb7897 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.780425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038bddb-c064-427d-8637-e2cb32afd5be None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:03.782100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.782905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.783191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.783472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.796410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.797985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-64eae54b-3aff-4cb5-8034-f426b2d8c34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:03.815897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:03.816857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:03.818187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:03.818187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:03.818187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:03.818187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:03.818410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fe82a-ff59-421f-81b3-35b7ad157dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:03.818510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 390/784] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:03.818591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe82a-ff59-421f-81b3-35b7ad157dc9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.818591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe82a-ff59-421f-81b3-35b7ad157dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.818591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe82a-ff59-421f-81b3-35b7ad157dc9 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.818768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d249-1520-47f0-a70c-2459f5429ed6 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.819084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d249-1520-47f0-a70c-2459f5429ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.819248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe82a-ff59-421f-81b3-35b7ad157dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:03.819340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d249-1520-47f0-a70c-2459f5429ed6 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.820652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe82a-ff59-421f-81b3-35b7ad157dc9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:03.824778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 391/785] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:03.825642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3d249-1520-47f0-a70c-2459f5429ed6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:03.827346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 395/786] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:03.828814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:03.829101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:03.829386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:03.849845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:03.849845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:03.971486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 396/787] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:03.995541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.069128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3d249-1520-47f0-a70c-2459f5429ed6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.117445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f421215-74ed-49a1-acd7-ff83b177631d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.122259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.122938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.123221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.123496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.124230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:04.124537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.125945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:04.147693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 392/788] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:04.153252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.155902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.156753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.157096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.157385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.168946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:04.176884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:04.177823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:04.178764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 397/789] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:04.187807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.310741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ed4cf-0ec8-4856-aeab-4f5f4ef17471 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.349999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.351093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.351387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.351668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.352590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:04.352902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.355282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:04.365284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 398/790] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:04.370996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.378598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b24f-81be-48c0-aea9-e5f9f4152b30 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.423078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.423883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.424165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.424436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.435783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.437235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:04.480968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b0a56-e027-4f44-a88d-6538fe17be4b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:04.484407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:04.486531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:04.488994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 393/791] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:04.495198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.517931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.518783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.519068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.519348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.532007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.533528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:04.552576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:04.554501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:04.555577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:04.555577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:04.555577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:04.555577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:04.555577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 399/792] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:04.562683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.684310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de917290-fbca-446d-8c45-1fe7cb8391c4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.738695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4de7-0ca0-417d-a8b6-1f0ca33cda64 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.763168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.764206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.764692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.765164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.766275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:04.766786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.768399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:04.774640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.775458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.776365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.776843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.777691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:04.778052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.779417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:04.792797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 400/793] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:04.796438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 394/794] 10.222.0.84 () {56 vars in 1135 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:04.801759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.802116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:04.909167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a05ec-dfce-4945-94da-5f7ab0ccab33 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:04.950616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:04.951435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:04.951715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:04.951988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:04.967507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:04.968984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:05.002173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:05.003129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:05.004014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:05.004014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:05.004014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:05.004014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:05.004246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c04ae-085a-49b1-a36d-1a53bf4bf8c6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.015345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 401/795] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:05.018766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.070968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.071794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.072180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.072507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.091123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.092599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:05.126081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:05.128479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:05.130697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 395/796] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:14:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:05.138198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.166468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390023d-c9b5-4f28-9185-db14371ead44 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.202574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.203248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.203531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.203811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.204534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:05.204841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.206251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.218600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 402/797] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:05.223775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.329518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88849801-aa90-466c-a5f1-b4798ef8e041 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.370562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.371241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.371373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd01132-2265-4aa0-8952-ca1b7952dbab None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.371568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.371850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.372882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:05.373197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.375245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cdeef-ea2a-4722-b055-fb18c374a8c1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.398920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 396/798] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:05.400728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ba91-fc6e-4d63-b8f7-20bf3aff8c48 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.401024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ba91-fc6e-4d63-b8f7-20bf3aff8c48 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.401633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ba91-fc6e-4d63-b8f7-20bf3aff8c48 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.403690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 397/799] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:05.404930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ba91-fc6e-4d63-b8f7-20bf3aff8c48 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.409359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.410276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.410633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.410980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.419082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.420581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-8e37fc47-218a-471c-9d98-8d4176e7e3bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:05.435632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:05.436580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:05.437459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 403/800] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:05.438783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.441364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.441364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.466454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:05.468379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:05.527208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ba91-fc6e-4d63-b8f7-20bf3aff8c48 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.561884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 404/801] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:05.563106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.564654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.565375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.565773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.566183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.654467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.656715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.675465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ae00-89ac-4bd6-aa96-022d53c0d0d3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.713612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.714839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.715274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.715875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.717121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:05.717599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.719223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.740565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 405/802] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:05.740565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.780369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 398/803] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 18:14:05.781350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.875695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4b587-af67-4966-a6b8-2614bd5f386d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.894552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed101cd-6da8-422c-ac2d-bb0cf491ef67 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:05.910556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.911549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.912134 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.912625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.924636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:05.933752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:05.934767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:14:05.935618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:05.937445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:05.938509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:05.938830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 406/804] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:05.939168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:05.939382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/3e8d13580356499dafd5a8eaa7b14d4f/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:05.940435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:05.941659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=3e8d13580356499dafd5a8eaa7b14d4f, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:05.943325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:05.961886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 399/805] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:05 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/3e8d13580356499dafd5a8eaa7b14d4f/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:14:05.963696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.081503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5058-bd76-4d02-9d30-ac2b73c50a03 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.120946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af924-ae9b-4005-ab0a-302fce2ed785 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.130046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.130944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.131235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.131513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.147314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.149579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.161083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.161845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.161978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.162342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.163110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:06.163418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.164793 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-cf841274-2085-42e9-8ce9-4b5c6f137ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:06.172730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:06.174013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:06.174924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:06.174924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:06.174924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:06.174924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:06.174924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 407/806] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:06.175804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8291-37d5-4655-af13-562014a5ee8e None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.175804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8291-37d5-4655-af13-562014a5ee8e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.176103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8291-37d5-4655-af13-562014a5ee8e None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.177366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 408/807] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:06.178771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 400/808] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:06.183020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.183576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.184044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.184276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.205851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:06.206949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:06.288857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 409/809] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:06.293963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.310149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8dc1e-4f60-4a55-a30f-c006f03a2bf0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.355483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.356183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.356464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.356738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.357954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:06.358264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.360376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.376906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 401/810] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:06.378083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.421587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399279-1ec6-4056-9370-690f961a3a37 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.465586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.466434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.466720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.466998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.484211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.486489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:06.511556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:06.512587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:06.513566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:06.513566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:06.513566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:06.513566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:06.513842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbee90-7dc7-4fa1-9c18-2862c5f07499 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.516095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 410/811] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:06.516342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.554190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.554994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.555269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.555538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.556190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.558176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:06.570289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:06.571310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:06.573052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 402/812] 10.222.0.84 () {56 vars in 1129 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:06.573959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.624387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3d2f-54dc-4eb8-89b5-4891f691b220 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.659452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.660238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.660521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.660809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.667838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.669275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.682997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580766e-f9af-4016-ace1-dbb5bc3a346f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b6a3c855-8dc0-47f9-9a8b-c2a887bf1a86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:06.683249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:06.684313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:06.685225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 411/813] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:06.685873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a640b2-3770-41cb-8cc6-917a049f26f4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.685873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a640b2-3770-41cb-8cc6-917a049f26f4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.686162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a640b2-3770-41cb-8cc6-917a049f26f4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.691349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 412/814] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:06.692115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a640b2-3770-41cb-8cc6-917a049f26f4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.722414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.723179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.723590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.723841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.724725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:06.725031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.726459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.743892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 403/815] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:06.743892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.802748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a640b2-3770-41cb-8cc6-917a049f26f4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.839945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec3323-1f53-46b7-96bc-b436ca0a96c8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:06.840380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.840992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.841268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.841542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.842275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:06.842589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.843936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f0f-dc19-454b-9be7-d3aa45d09c73 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.852968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 413/816] 10.222.0.84 () {56 vars in 1124 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:06.852968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.852968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.852968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.868111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:06.870162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:06.880051 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:06.880654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:06.880937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:06.881210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:06.882031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:06.882336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:06.883755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:06.895302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 404/817] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:06.896136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:06.941377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 414/818] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:06.942616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.006732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57695e30-8385-4e46-8e4f-024949fd2bb9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.038981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79acd-236c-4e6d-9ebc-07d808711873 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.040482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.041854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.042148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.042417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.049776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.051276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:07.066445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:07.067554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 405/819] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:07.069124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.077786 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.078477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.078760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.079034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.079739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:07.080042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.081404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.091248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 415/820] 10.222.0.84 () {56 vars in 1124 bytes} [Fri May 13 18:14:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:07.091248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.167772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e96b3-7d23-467d-b8b6-d74f75970bac None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.189291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416691-d03f-4877-991a-8f38cd27e5e5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.203473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.204126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.204408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.204685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.205524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=b5e358b1f53b408f8f1e9661ac754c39) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:07.205855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.207284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.221829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 406/821] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/role_assignments?user.id=b5e358b1f53b408f8f1e9661ac754c39&scope.project.id=31dac20388d84281bab425701bac98be&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:07.221829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.236411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.237331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.238512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.238808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] PATH_INFO: `/v3/services/network` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.239843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.241430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:07.258550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:07.260576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:07.262086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 416/822] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:07.262940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.337829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff2a9c-0aee-4cac-9ca3-fb4973316d57 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.372535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.373227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.373517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.373809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.374736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:07.375102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.376617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.378739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebd428-5d61-46bc-a29c-9f6403a21ee6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.396271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 407/823] 10.222.0.84 () {56 vars in 1149 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:07.397157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.420244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.420908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.421186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.421459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.422252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.423615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.452753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 417/824] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:07.453672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.542763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8e0d-6217-4206-801d-58d818673aec None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.599436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.600342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.600626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.600903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.601078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d188c0-f267-40a1-ac8e-2e2a7b797de1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.601627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] RBAC: Adding query filter params (name=network) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:07.601963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.605162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.611174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 408/825] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:07.617165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.651799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.652628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.652911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.653187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.666485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.667956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:07.692889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:07.695077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:07.697313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:07.697313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:07.697313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:07.697313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:07.697313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 418/826] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:07.705839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.742090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0dd3-2753-406e-abe7-fda4292dcf13 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.799665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.800549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.800834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.801119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.802035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] RBAC: Adding query filter params (type=network) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:07.802653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.804041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.811960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 409/827] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:07.818230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.820052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0c17-e625-48f4-b03a-77cd666c9faf None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:07.856024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:07.856966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:07.857245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:07.857676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:07.858756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:07.859381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:07.860815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:07.876949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 419/828] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:07.882755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:07.982235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5d32-5f78-43ad-b760-1b8c3ac56c2c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:08.021169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:08.021858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.022139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.022420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.023162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:08.024528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:08.043008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab6bf8-8815-40e5-9fd8-0e7c1178a7b1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:08.060223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 410/829] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:08.091621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:08.092938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.093449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.093987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.101835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:08.104170 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:08.120891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:08.121920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:08.122890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:08.125722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 420/830] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:08.133849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:08.304679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731263-8751-4cbd-9102-548df0bfe5da None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:08.349347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:08.349981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.350267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.350546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.351357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:08.351672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:08.353099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c94fd-fb7a-411b-b371-717f8f9915d7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:08.374714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 411/831] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:08.380265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:08.467233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9a68-6678-46e5-b0d0-f0b3ecea5076 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.467601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9a68-6678-46e5-b0d0-f0b3ecea5076 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.467954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9a68-6678-46e5-b0d0-f0b3ecea5076 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.474256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 412/832] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:08.476128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.476128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.476128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.499669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:08.500958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:08.503111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63c757-e9f8-44c4-baf7-7f322b0b343a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:08.547393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:08.548305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.548586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.548866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/31f30b58e64c45beb61a9ec51c9526da/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.565645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=31f30b58e64c45beb61a9ec51c9526da, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:08.567162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:08.585323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 421/833] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:08 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/31f30b58e64c45beb61a9ec51c9526da/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:14:08.586428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 413/834] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:08.615047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:08.730745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9577fa-a1cf-4b81-bbd8-34d50b6f3764 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:08.769459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:08.770304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.770590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.770869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.783063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:08.791427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:08.792581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:08.793645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 422/835] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:08.798968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:08.907203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131088bc-3c59-4188-b915-a8790cfc40e8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:08.944299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:08.945008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:08.945296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:08.945574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:08.946459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:08.946781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:08.949089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:08.958754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 414/836] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:08.964735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:09.069051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d691c-eab7-4093-b9a7-0c1a3b4ac1c5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:09.104467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:09.105269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:09.105553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:09.105904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:09.118120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:09.119682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:09.139050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:09.141349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:09.143492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:09.143492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:09.143492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:09.143492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:09.143492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 423/837] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:09.146315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:09.249561 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269961c-dfef-4033-adab-b6974619e37e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:09.284277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:09.284949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:09.285234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:09.285511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:09.286283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:09.286591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:09.287961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:09.300826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 415/838] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:09.306971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:09.410163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4d71-c901-4079-ba9a-f30b140ecfe0 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:09.449749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:09.450588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:09.450874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:09.451150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:09.461047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:09.461047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:09.476996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:09.479608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:09.481517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 424/839] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:09.490043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:09.595858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac57d-7b33-48ca-8a95-ec06565f85a5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:09.632951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:09.634050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:09.634606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:09.635369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:09.636422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:09.636982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:09.638650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:09.658306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 416/840] 10.222.0.84 () {56 vars in 1135 bytes} [Fri May 13 18:14:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:09.664413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:09.774617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ab62-449c-4cc1-bdd5-994d69d50d02 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:09.811092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85332401-44bc-4037-966e-83572b95a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:09.811760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85332401-44bc-4037-966e-83572b95a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:09.812070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85332401-44bc-4037-966e-83572b95a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:09.812434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85332401-44bc-4037-966e-83572b95a7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:09.888235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85332401-44bc-4037-966e-83572b95a7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:09.889604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85332401-44bc-4037-966e-83572b95a7c4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:09.996991 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 425/841] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:10.002873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.023813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3bda1-6ac0-4ec9-bb50-a77efc6cdf59 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.024012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3bda1-6ac0-4ec9-bb50-a77efc6cdf59 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.024260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3bda1-6ac0-4ec9-bb50-a77efc6cdf59 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.026611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 426/842] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:10.031877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd1d8-2ea5-4e1a-96c9-250b4998920c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.032169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd1d8-2ea5-4e1a-96c9-250b4998920c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.032457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd1d8-2ea5-4e1a-96c9-250b4998920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.051729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4b6bd1d8-2ea5-4e1a-96c9-250b4998920c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:10.053245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4b6bd1d8-2ea5-4e1a-96c9-250b4998920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:10.127983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 427/843] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:10.129738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf3d4d-d714-4e7b-8884-cdd79660b972 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.139297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d7ab-dfcb-42c7-9df4-e1a727343e69 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.139570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d7ab-dfcb-42c7-9df4-e1a727343e69 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.139831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d7ab-dfcb-42c7-9df4-e1a727343e69 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.141425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 428/844] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:10.146470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.146761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.147069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.164410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:10.165588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:10.169872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.170883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.171320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.171746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.182516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.184200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:10.204128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:10.205113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:10.206466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:10.206466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:10.206466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:10.206466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.206466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 417/845] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:10.206466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.236299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 429/846] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:10.237447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.326082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2cf7-ce48-45d2-8e69-19df923b2a80 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.356854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482701-729f-4bbe-b010-27e8dd17a7d4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.361964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.363040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.363327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.363608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.364262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.365634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:10.378615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:10.379625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.380486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 418/847] 10.222.0.84 () {56 vars in 1132 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:10.381372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.399837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.401202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.401478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.401756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.402518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:10.402985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.404207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.421402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 430/848] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:10.421402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.491471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ab8ed-2b83-4eab-a50d-345d3137dab3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.526825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.527626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.527904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.528178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b798e-d548-48ec-86dd-ba7d235ac318 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.528282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.528862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.530257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:10.542808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:10.543896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.544744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 419/849] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:10.545551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.568228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.568893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.569175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.569443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.570196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:10.570505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.571901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.576384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 431/850] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:10.577300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.652386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff8a2d-093a-4263-9fb8-b02058ef4e2b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.678675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945cdd0-3983-486b-8587-58963892da23 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.692355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.693154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.693437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.693713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.701056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.702582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:10.718377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:10.720992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:10.723230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:10.724361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.724361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.724361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.724361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.725033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:10.725033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.725033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.725422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 420/851] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:10.725915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.730625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 432/852] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:10.731499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.831089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a92b2-5c12-432a-826f-91ae1f9a4749 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.843724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f42b-470b-4322-ac11-f94269ae783d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:10.867322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.867989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.868452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.869498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.870274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:10.870584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.871952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.883616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 421/853] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:10.883616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.892706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:10.894109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.894388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.894664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.895911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:10.896289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:10.898652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fb860-5525-45f6-b0b2-df3c9c34e219 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:10.917933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 433/854] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:10.919435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39314-0590-4628-9d2f-3d5762346b8f None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:10.919724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39314-0590-4628-9d2f-3d5762346b8f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:10.920004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39314-0590-4628-9d2f-3d5762346b8f None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:10.921869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 434/855] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:10.923837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39314-0590-4628-9d2f-3d5762346b8f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:10.994665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be451e-c93f-4a71-9395-7844ba1ac41e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.029960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.030642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.030926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.031204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.031925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:11.032228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:11.033616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48cf68-e406-4c22-a489-bc815408e0e3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:11.037464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39314-0590-4628-9d2f-3d5762346b8f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.050102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 422/856] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:11.050102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.050102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.050102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.067166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:11.068402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:11.084746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.085422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.085701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.086007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.086865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=3e8d13580356499dafd5a8eaa7b14d4f) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:11.087175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:11.089416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:11.097527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 435/857] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:10 2022] GET /identity/v3/role_assignments?user.id=3e8d13580356499dafd5a8eaa7b14d4f&scope.project.id=31dac20388d84281bab425701bac98be&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:11.152608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 423/858] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:11.177638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:11.291374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0cf8-8f44-4f40-bbd0-569378d2fab7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.328415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.329533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.330019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.330469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.341614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:11.349695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:11.350662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:14:11.351512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:11.354638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 436/859] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:11.360537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:11.463571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe6dd0-2075-4c90-9fc6-461b1caa5148 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.498654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.499344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.499602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.499878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.500628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:11.500938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:11.502355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:11.511812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 424/860] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:14:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:11.517127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:11.617464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e268743-47b4-4440-bc7d-6446c8983537 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.651300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.652078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.652373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.652626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.663602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:11.665054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:11.683239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:11.684188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:11.685066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:11.685066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:11.685066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:11.685066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:11.685066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 437/861] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:11.691416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:11.795315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eaab5-850e-4323-a725-b545df302c4a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.836244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.836918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.837204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.838061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:11.839064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:11.839382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:11.840772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:11.854452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 425/862] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:11.859918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:11.962029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8f0d6-1a66-47d7-92ff-31b403f69bba None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:11.996082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:11.997273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:11.997751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:11.998274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:12.006050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:12.007700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:12.023015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:12.023979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:12.025012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:12.028398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 438/863] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:14:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:12.034886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:12.140701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794807f5-bf1e-4ce7-8121-d1acb75d3f0a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:12.180802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:12.182130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:12.182640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:12.183111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:12.184150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:12.184656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:12.186315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:12.205870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 426/864] 10.222.0.84 () {56 vars in 1149 bytes} [Fri May 13 18:14:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:12.211245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:12.313093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37378-22c2-46ba-8fa9-0b8c8b5abca3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:12.346761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:12.348719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:12.349225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:12.349699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:12.424332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:12.425693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:12.533604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 439/865] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:12.539674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:12.646604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c246-9cb9-4680-8b7d-396ae63da39c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:12.682219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:12.682934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:12.683218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:12.683496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:12.693713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:12.695185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:12.714680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:12.715627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:12.716506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:12.716506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:12.716506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:12.716506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:12.716506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 427/866] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:12.722831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:12.823360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e5a4-5534-47fe-8e08-5701a1e432ea None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:12.859287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:12.860366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:12.860845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:12.861316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:12.862280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:12.863062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:12.864658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:12.877697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 440/867] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:12.883503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:12.984546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b104de-d6e3-415a-8cd5-47648044b34b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:13.019187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:13.020325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.020801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.021286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.028580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:13.030321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:13.044633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:13.045531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:13.046564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:13.048762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 428/868] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:13.054514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:13.167742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c309-accb-44ba-8ae0-60541edd944e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:13.208655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b272-6212-4a28-ad18-810909202bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:13.209344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b272-6212-4a28-ad18-810909202bda None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.209629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b272-6212-4a28-ad18-810909202bda None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.209940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b272-6212-4a28-ad18-810909202bda None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.210762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b272-6212-4a28-ad18-810909202bda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:13.211078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b272-6212-4a28-ad18-810909202bda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:13.213732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b272-6212-4a28-ad18-810909202bda None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:13.228247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 441/869] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:13.234726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:13.343590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af401-b492-4c76-be5d-baa823d6bd0e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:13.366357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f2efc-8138-4cb8-b650-2f0859d2c0ac None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.366625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f2efc-8138-4cb8-b650-2f0859d2c0ac None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.366910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f2efc-8138-4cb8-b650-2f0859d2c0ac None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.368557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 442/870] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:13.374552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.374826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.375104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.378528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:13.379199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.379485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.379766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.380624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=31f30b58e64c45beb61a9ec51c9526da) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:13.380942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:13.382468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f664392-7814-4097-b8bf-537b1e63c4b3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:13.390245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 429/871] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:13 2022] GET /identity/v3/role_assignments?user.id=31f30b58e64c45beb61a9ec51c9526da&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:13.395105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:13.396767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:13.425282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5259d0-6b3c-4af0-a4ab-f66ba293238f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.425282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5259d0-6b3c-4af0-a4ab-f66ba293238f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.425556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5259d0-6b3c-4af0-a4ab-f66ba293238f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.427171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 430/872] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:13.433290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.433607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.434261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.452855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:13.453717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:13.481271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 443/873] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:13.504729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:13.529229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 431/874] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:13.552343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:13.614840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322777c8-37dd-4503-8817-e71f7360a18a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:13.653608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9ee82-5258-4745-a44d-7bdf1b36b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:13.654386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9ee82-5258-4745-a44d-7bdf1b36b691 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.654669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9ee82-5258-4745-a44d-7bdf1b36b691 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.655773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9ee82-5258-4745-a44d-7bdf1b36b691 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.655773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9ee82-5258-4745-a44d-7bdf1b36b691 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:13.657013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9ee82-5258-4745-a44d-7bdf1b36b691 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:13.673692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 444/875] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:14:13 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:13.674610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f741b-6cd6-4311-8ec3-3cdf19a16e76 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:13.675334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c782ea-e8e2-4b83-bbcd-649dd855a023 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.675631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c782ea-e8e2-4b83-bbcd-649dd855a023 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.675911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c782ea-e8e2-4b83-bbcd-649dd855a023 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.677191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 445/876] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:13.683873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.684255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.684539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.710269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:13.713518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:13.729591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:13.731057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.731658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.732202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.733055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:13.734880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:13.758585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 432/877] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:14:13 2022] POST /identity/v3/services => generated 269 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:13.813667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 446/878] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:13.836707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:13.960539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da1211-f7e0-4338-92ed-afdb9e38adb4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:13.996524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:13.997343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:13.997617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:13.997931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:13.998600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:13.999979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:14.013677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:14.014760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:14.015615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 433/879] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:14.022803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:14.123421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111de6-33e6-4e8b-b705-c6527711f5ba None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:14.161674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:14.162810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:14.163295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:14.163787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:14.164722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:14.165249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:14.167467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80476cb1-9146-4cdd-80f4-bc42a0843274 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:14.172926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 447/880] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:14.178732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:14.284017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66359c20-474e-4be2-8147-994b125a0905 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:14.319524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:14.320547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:14.321049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:14.321557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:14.322541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:14.323074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:14.324654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccae673-b05b-4d16-b87e-284ea4ce5bcb None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:14.330260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 434/881] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:15.810436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f690b-d288-4bff-8682-cf1847d8f2cc None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:15.810982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f690b-d288-4bff-8682-cf1847d8f2cc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:15.810982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f690b-d288-4bff-8682-cf1847d8f2cc None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:15.812614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 448/882] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:15.818225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54369591-199b-415e-81f2-dc71f6c7bcbb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:15.818706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54369591-199b-415e-81f2-dc71f6c7bcbb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:15.818886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54369591-199b-415e-81f2-dc71f6c7bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:15.836334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-54369591-199b-415e-81f2-dc71f6c7bcbb None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:15.838298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-54369591-199b-415e-81f2-dc71f6c7bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:15.909290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 435/883] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:15.933939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f690b-d288-4bff-8682-cf1847d8f2cc None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.040168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f690b-d288-4bff-8682-cf1847d8f2cc None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.076411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.077265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.077575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.077947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.089531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:16.093089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5577a-baec-4932-bd8f-d623aba6111e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.093379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5577a-baec-4932-bd8f-d623aba6111e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.093658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5577a-baec-4932-bd8f-d623aba6111e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.095298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 436/884] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:16.098171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:16.099117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.099958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 449/885] 10.222.0.84 () {56 vars in 1120 bytes} [Fri May 13 18:14:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:16.103976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d933a-ae17-4f1e-bc58-6ad3d052ff71 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.104280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d933a-ae17-4f1e-bc58-6ad3d052ff71 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.104521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d933a-ae17-4f1e-bc58-6ad3d052ff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.106387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.124457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c22d933a-ae17-4f1e-bc58-6ad3d052ff71 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:16.126815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c22d933a-ae17-4f1e-bc58-6ad3d052ff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:16.195097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 437/886] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:16.196430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaa6b8-958b-4cb0-bd42-9a4378bd086c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.197206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaa6b8-958b-4cb0-bd42-9a4378bd086c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.197694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaa6b8-958b-4cb0-bd42-9a4378bd086c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.199232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 438/887] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:16.204572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.204864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.205144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.219420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8507a7-addd-4ad5-9079-565769bac752 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.224532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:16.225717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:16.254562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.255252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.255540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.255807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.256549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:16.256851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.258240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.271559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 450/888] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:16.271559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.301175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 439/889] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:16.302431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.378848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940aa1a-2cd7-476c-896f-12b6291f3673 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.411723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7b07-9adb-49bc-8b95-e9f0cbe7777e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.413279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.414144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.414421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.414692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.415886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.417249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:16.428883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:16.429993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.430877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 451/890] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:16.434049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.454073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.454936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.455213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.455484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.471969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.473456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:16.495669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:16.496643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:16.497547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:16.497547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:16.497547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:16.497547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:16.497547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 440/891] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:16.497865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.546191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bed51-2dab-42a4-a33d-9498b32dd307 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.580075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.580895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.581180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.581466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.582157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.583523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:16.596718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:16.597701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:16.598579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 452/892] 10.222.0.84 () {56 vars in 1132 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:16.599409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.601107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb33d3-d72a-4e79-86ad-97fc8f325b2e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.639825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.640409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.640690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.640966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.641672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:16.642439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.643813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.648445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 441/893] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:16.649221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.706203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2164e1-ecce-43b2-9480-f2e2277a75f6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.742616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.743280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.743887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.743984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63ce65-d2fc-4e6f-9833-09b0a4b6a631 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.744255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.745003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:16.745317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.746725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff921-d64d-41b0-b375-fab44d0de420 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.758228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 453/894] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:16.760167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a692e30-ffeb-478f-85ab-201d10825b50 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.760449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a692e30-ffeb-478f-85ab-201d10825b50 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.760724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a692e30-ffeb-478f-85ab-201d10825b50 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.762129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 454/895] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:16.764254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a692e30-ffeb-478f-85ab-201d10825b50 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.778037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.778704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.778979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.779252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.779953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:16.780253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.781604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.786076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 442/896] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:16.786843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.863998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a692e30-ffeb-478f-85ab-201d10825b50 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.883987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b51d29-2104-48d2-98b9-146298d765a4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:16.896386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.896980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.897256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.897531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.898260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:16.898569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.900623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778df8a5-fe84-484e-bda8-8f50895d5d23 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.905243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 455/897] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:16.906444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.906728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.907003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.919091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:16.919903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:16.920190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:16.920468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:16.923176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:16.924338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:16.927789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:16.929225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:16.944174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:16.945349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 443/898] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:16.946894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:16.988723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 456/899] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:16.989566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.045868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dd01b-89ce-4b50-b626-710b042ddfcd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.079227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.079886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.080170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.080448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.081151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:17.081457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.082854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.083628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364112-c33e-43f6-9206-5ef4fdc70548 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.088543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 444/900] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:17.089331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.117287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.117975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.118256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.119089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.119883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] RBAC: Adding query filter params (interface=public, service_id=998caeaec7ed47debd7eee1499f0c8ab, region_id=RegionOne) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:17.120193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.121553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.126505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 457/901] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:16 2022] GET /identity/v3/endpoints?service_id=998caeaec7ed47debd7eee1499f0c8ab&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:17.127259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.186764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3960f-9b10-441c-b0e1-fbeff3f1ed26 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.219674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.220329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.220613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.220880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.221703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:17.222036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.222428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042517ac-f80d-4ca5-8d12-560b75603415 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.223460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.240679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 445/902] 10.222.0.84 () {56 vars in 1149 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:17.241396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.256318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.256983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.257264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.257538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.258286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.260175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.274281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 458/903] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:14:17 2022] POST /identity/v3/services => generated 241 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:17.276066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.349145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5f84f-e870-4d5f-92a7-7a23c61d8064 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.395375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.396048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.396342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.396619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.396744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d340c-9dd0-4c02-be4d-8badf8cb9514 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.397434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] RBAC: Adding query filter params (interface=public, service_id=d12ea8d4405240c7be56a38f5b4d09dc, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:17.397752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.399209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.406169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 446/904] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/endpoints?service_id=d12ea8d4405240c7be56a38f5b4d09dc&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:17.407122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.435452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.436141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.436485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.436819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.437472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.438925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.445866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 459/905] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:14:17.446284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.533221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b65851-ea67-4dbb-b707-031495a7d0cd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.571747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.572450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.572776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.573054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.579422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb6b33-a14f-4a37-8532-13bee006fbdd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.613384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.614090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.614367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.614637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.615327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.616707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.623550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 460/906] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:14:17.651936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.653441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.766662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 447/907] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:17.772084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:17.879083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d66b3d-6ca9-4d21-aeee-6e972fcf137c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:17.914561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:17.916421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:17.916943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:17.917431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:17.928408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:17.930229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:17.950094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:17.951040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:17.952096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:17.952096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:17.952096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:17.952096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:17.954866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 461/908] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:17.965830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:18.061422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c38c1-2f0d-4f50-b2df-1ee2538aa024 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:18.096655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:18.097325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:18.097608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:18.097910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:18.098636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:18.098945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:18.100324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:18.113293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 448/909] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:18.119107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:18.228600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895aa13-9720-4b5c-a9bc-72f627d9848b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:18.263658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:18.264454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:18.264734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:18.265007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:18.272030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:18.273469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:18.287759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:18.289903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:18.292260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 462/910] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:18.295363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:18.396060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092621-bd40-40f2-8d64-487135a8114f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:18.429853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:18.430515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:18.430816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:18.431616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:18.432410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:18.432719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:18.434175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a3169-1baa-4a64-977f-c638ab82538d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:18.446799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 449/911] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:18.452530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:18.561781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b1af-45db-4371-8bf4-b5010b147f79 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:18.595587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:18.596238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:18.596517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:18.596788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:18.597615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] RBAC: Adding query filter params (role.id=bda6652e7fdb424194123022cf88391e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=31f30b58e64c45beb61a9ec51c9526da) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:18.597953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:18.599427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26507-46ca-4707-a231-c29db3fa164b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:18.605782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 463/912] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:18 2022] GET /identity/v3/role_assignments?user.id=31f30b58e64c45beb61a9ec51c9526da&scope.project.id=31dac20388d84281bab425701bac98be&role.id=bda6652e7fdb424194123022cf88391e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:19.699128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5082812-de92-41c3-98fe-26b36a3eb1d5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:19.699690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5082812-de92-41c3-98fe-26b36a3eb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:19.699690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5082812-de92-41c3-98fe-26b36a3eb1d5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:19.701340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 450/913] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:19.706870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:19.707709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:19.708207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:19.726969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:19.728641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:19.790766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28715de-318b-47a6-beb9-73c9723e9ecc None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:19.791428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28715de-318b-47a6-beb9-73c9723e9ecc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:19.791939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28715de-318b-47a6-beb9-73c9723e9ecc None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:19.797893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 451/914] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:19.799497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:19.799989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:19.800465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:19.811550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 464/915] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:19.817765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:19.819247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:19.834441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:19.892736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 452/916] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:19.915840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:19.940849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fc2a2-c661-4b8a-9715-e9366dab8e86 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:19.976203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:19.977120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:19.977351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:19.977698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:19.979151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:19.980585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-021cfb72-950e-41fa-9c54-aeef8dec8283 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:19.993690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:19.995719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:19.997020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:20.001567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 465/917] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:20.003193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b904-d9f8-4e4d-89cd-7e17e197113e None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.003486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b904-d9f8-4e4d-89cd-7e17e197113e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.003767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b904-d9f8-4e4d-89cd-7e17e197113e None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.005091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 466/918] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:20.007106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839b904-d9f8-4e4d-89cd-7e17e197113e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.022171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b52d-a7ca-48c5-955c-2604ab393939 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.056612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.057498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.057819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.058083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.058744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.060108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-68b9f16e-7c95-4dd2-bf48-ff32ba73e09d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:20.071901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:20.072956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:20.073831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 453/919] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:20.075267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.075267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.075267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.094618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:20.095804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:20.119574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839b904-d9f8-4e4d-89cd-7e17e197113e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.155005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.155005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.155005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.155550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.155944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:20.156250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.157615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.166015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 467/920] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:20.167151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.170608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 454/921] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:20.171711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.279434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482a2e-3383-4176-8768-e2ba533e03b7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.279742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f776ed-9f05-4920-bbce-cc6d21d470f5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.313611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.314307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.314591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.314864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.315568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:20.315749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.315863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.316392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.316673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.316949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.317224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.317657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:20.317991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.319354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.323259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 468/922] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:20.324092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.334151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 455/923] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:20.334151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.426469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4820a-c87a-4515-b9ac-ac1e2ef7670c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.432946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93760-306e-43e6-9927-1530942fb8dc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.462176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.462915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.463194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.463465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.464122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.465489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.469956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.470627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.470967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.471248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.472021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:20.472328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.475740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:20.478354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:20.479524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 18:14:20.480366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:20.486303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 456/924] 10.222.0.84 () {56 vars in 1114 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:20.486303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.486459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 469/925] 10.222.0.84 () {56 vars in 1132 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:20.486459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.590518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650ec1-e818-4868-a1a8-806df2374f72 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.596180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21d467-c190-476d-a167-2d9284b1196e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.628521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.629279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.629560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.629862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.630184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.630652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] RBAC: Adding query filter params (interface=public, service_id=37f33e10ec1044ecb1216db53f8e13d2, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:20.630840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.630998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.631148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.631387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.632087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:20.632316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.632419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.633723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.639247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 457/926] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/endpoints?service_id=37f33e10ec1044ecb1216db53f8e13d2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:20.639794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 470/927] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:20.639972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.644587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.751069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242af9-dc93-46fd-b4b0-45d303c3622d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.752500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee877a6-46a2-487c-bb0d-2f00b7c983f7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:20.788572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6498a-dbf4-44a3-a5df-b0b62a4eb5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.789234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6498a-dbf4-44a3-a5df-b0b62a4eb5a3 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.789351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:20.789529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6498a-dbf4-44a3-a5df-b0b62a4eb5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.789783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6498a-dbf4-44a3-a5df-b0b62a4eb5a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.789979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.790290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.790567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6498a-dbf4-44a3-a5df-b0b62a4eb5a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.791221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.791917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:20.792041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6498a-dbf4-44a3-a5df-b0b62a4eb5a3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.793392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:20.800128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 471/928] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:14:20.801095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:20.826379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 458/929] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:20.885833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7ca35-4d27-4456-916b-1531f2c75922 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.886019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7ca35-4d27-4456-916b-1531f2c75922 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.886289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7ca35-4d27-4456-916b-1531f2c75922 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.888041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 459/930] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:20.893648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:20.893978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:20.894238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:20.912806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:20.914080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:20.950934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e14f9-8ae7-49b1-a53f-8adbd2bda53b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.004659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 460/931] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:21.011522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.012233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.012519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.013506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.013506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:21.017831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:21.017831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:21.022114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 472/932] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:21.027735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:21.035761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:21.153048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917857c-1eed-4b0f-97db-02b793898edf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.164321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a7f5-593d-4c4e-be62-e39ca072912a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.197878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.198553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.198932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.199214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.199317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.199979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:21.200156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.200411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.200782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.201363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:21.213652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:21.224308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:21.225330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:21.226263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 473/933] 10.222.0.84 () {56 vars in 1120 bytes} [Fri May 13 18:14:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:21.227485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 461/934] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:21.235781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:21.361137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c7db1-5bb4-4749-8389-3c4a94d58829 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.405465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.406570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.407072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.407578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.408580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:21.409127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:21.410771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:21.420986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 474/935] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:14:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:21.426604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:21.537048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1b4ef-1091-4e7c-8753-7f1e21c5461d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.571183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.572230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.572513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.572786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.583610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:21.585053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:21.603170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:21.604594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:21.605495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:21.605495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:21.605495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:21.605495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:21.605495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 462/936] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:21.610911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:21.713031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6002f-f1d9-4fa1-a60f-64900f92d790 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.749651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.750740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.751245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.751724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.752648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:21.753585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:21.755183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:21.767992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 475/937] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:21.777880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:21.886443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b690183-f8d7-4eea-ae0f-a511ad1acbfc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:21.920875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:21.921953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:21.922403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:21.922819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:21.932562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:21.934262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:21.949826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:21.951028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:21.952307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:21.954562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 463/938] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:14:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:21.960259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:22.065291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb62eb-7480-4f7c-9d78-6dff4aa5bcf3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:22.100656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:22.101610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:22.102068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:22.102513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:22.104086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:22.104541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:22.106333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:22.128539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 476/939] 10.222.0.84 () {56 vars in 1149 bytes} [Fri May 13 18:14:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:22.134980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:22.240246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69225c6-1e6c-479c-a2ca-1bf146b18ce2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:22.275075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:22.275872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:22.276151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:22.276424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:22.286980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:22.288424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:22.305541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:22.307058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:22.307947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:22.307947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:22.307947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:22.307947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:22.307947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 464/940] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:22.314165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:22.414581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb374-3c5a-43f9-acbf-480c63d55bbb None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:22.451388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:22.452489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:22.452978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:22.453469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:22.454465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:22.454972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:22.456542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:22.469271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 477/941] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:22.476449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:22.589783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697546c3-b841-4f09-adfd-f9a8d6b229da None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:22.626133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:22.626937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:22.627223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:22.627501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:22.634900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:22.636490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:22.651821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:22.652766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:22.653640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 465/942] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:22.659127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:22.765480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc820368-924c-4cd6-817b-6959cf8c0cef None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:22.800829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:22.801533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:22.801856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:22.802136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:22.802935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:22.803266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:22.804699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98eb92-e522-4bd9-be73-3a5f5b8187d4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:22.818567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 478/943] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:22.825386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:22.930112 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7c035-9e92-43a7-a2ee-88dfee0585e7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:22.971023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f6f0-fcc5-45d1-9208-e223c35e1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:22.971918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f6f0-fcc5-45d1-9208-e223c35e1e5d None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:22.972198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f6f0-fcc5-45d1-9208-e223c35e1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:22.972474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f6f0-fcc5-45d1-9208-e223c35e1e5d None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/31f30b58e64c45beb61a9ec51c9526da/roles/bda6652e7fdb424194123022cf88391e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:22.974743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f6f0-fcc5-45d1-9208-e223c35e1e5d None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=31f30b58e64c45beb61a9ec51c9526da, role_id=bda6652e7fdb424194123022cf88391e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:22.976184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f6f0-fcc5-45d1-9208-e223c35e1e5d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:22.992740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 466/944] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:22 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/31f30b58e64c45beb61a9ec51c9526da/roles/bda6652e7fdb424194123022cf88391e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:14:23.136987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b9308-b2de-43f1-a41d-e4a2764133ee None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.137376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b9308-b2de-43f1-a41d-e4a2764133ee None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.137611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b9308-b2de-43f1-a41d-e4a2764133ee None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.139299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 479/945] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:23.145112 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b4aca-ac3b-4a94-8070-7beed3405b0f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.145715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b4aca-ac3b-4a94-8070-7beed3405b0f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.146235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b4aca-ac3b-4a94-8070-7beed3405b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.168976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a41b4aca-ac3b-4a94-8070-7beed3405b0f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:23.170215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a41b4aca-ac3b-4a94-8070-7beed3405b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:23.247909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 467/946] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:23.271115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b9308-b2de-43f1-a41d-e4a2764133ee None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.275615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f62c3-9b27-4287-b813-376daddbc4a2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.275914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f62c3-9b27-4287-b813-376daddbc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.276201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f62c3-9b27-4287-b813-376daddbc4a2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.277878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 468/947] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:23.284068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.284417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.284700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.306573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:23.308371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:23.383205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 469/948] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:23.394687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b9308-b2de-43f1-a41d-e4a2764133ee None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:23.409944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.434330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:23.435239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.435526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.435806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.436701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:23.438076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:23.452257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:23.453348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:23.454218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 480/949] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:23.459658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.529197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d22c5-d5ff-466e-8ae6-b1239b9cd270 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:23.567268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:23.567976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.568264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.568543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.569251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:23.570708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:23.572148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56eb19-f28d-4832-8a1d-6554bcdbafe8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:23.572528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING keystone.server.flask.common [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 18:14:23.591260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.sql.core [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 18:14:23.591260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 18:14:23.591260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [parameters: {'id': '1451e26be1b241559a094bcb849e0446', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 18:14:23.591260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79984) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 18:14:23.608758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:23.609710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.610020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.610300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.611021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:23.611380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:23.613132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1451e26be1b241559a094bcb849e0446.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1451e26be1b241559a094bcb849e0446. May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result = self._query(query) May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application conn.query(q) May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 18:14:23.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result.read() May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 13 18:14:23.614388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return project_ref.to_dict() May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application next(self.gen) May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application yield resource May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application next(self.gen) May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.session.rollback() May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.force_reraise() May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise self.value May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application session.commit() May 13 18:14:23.615339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._prepare_impl() May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.session.flush() May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._flush(objects) May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application compat.raise_( May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application flush_context.execute() May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 18:14:23.616237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rec.execute(self) May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 18:14:23.617138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result = self._query(query) May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application conn.query(q) May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result.read() May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 18:14:23.618928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [parameters: {'id': '1451e26be1b241559a094bcb849e0446', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.620786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:23.628428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.Conflict( May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1451e26be1b241559a094bcb849e0446. May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 470/950] 10.222.0.84 () {60 vars in 1140 bytes} [Fri May 13 18:14:23 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:23.629387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.630551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 481/951] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:23.630792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.733522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54fec3-d1e6-4d19-830f-38ee734d918a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:23.736029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c98a-b653-48e8-a625-a881ed2e1a0a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:23.768504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:23.769296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.769581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.769885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.770469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:23.771141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.771427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.771705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.772440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:23.772751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:23.774180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f58e6c-863f-48ad-8db3-4a113e412919 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:23.778143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:23.784524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 482/952] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:23.784670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:23.784749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cd5b-3c99-4ea3-8ed6-dd9c5a9173fb None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.784749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cd5b-3c99-4ea3-8ed6-dd9c5a9173fb None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.784749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cd5b-3c99-4ea3-8ed6-dd9c5a9173fb None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.784749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 483/953] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:23.785077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cd5b-3c99-4ea3-8ed6-dd9c5a9173fb None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-31e9f141-455d-4f9a-a413-bd01318db4fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:23.801464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:23.802544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:23.804071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 471/954] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:23.804554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.804834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.805114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.823299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:23.824811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:23.892490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 472/955] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:23.893393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:23.898473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cd5b-3c99-4ea3-8ed6-dd9c5a9173fb None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:23.938364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:23.939036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:23.939315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:23.939598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:23.940341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:23.941819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:23.965829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 484/956] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:14:23.965829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:24.020194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a568e-4ed5-4df5-8215-178440a03a7e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:24.073169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:24.073867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:24.074153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:24.074535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:24.075318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:24.075431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebec4b-0ec6-4d62-9c73-06bb58ab97d7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:24.075622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:24.077084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:24.096318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 473/957] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:24.125348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:24.126219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:24.126498 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:24.126771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:24.127447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:24.128885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:24.142149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:24.143234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:24.144352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 485/958] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:24.149616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:24.273535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc7706-48f1-494e-89e8-5783ea84cd67 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:24.314207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:24.314890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:24.315172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:24.315447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:24.316173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:24.316478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:24.317896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf818cf-fcf3-45fa-a2c1-cdeeba1a5a27 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:24.324258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 474/959] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:24.330817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:24.465829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153ad54-e6cb-4361-83c5-da710f715026 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:24.500492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:24.501173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:24.501453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:24.501768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:24.502523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] RBAC: Adding query filter params (type=compute) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:24.503003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:24.505254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279820e-5c3b-494e-8a54-efc1653dec7b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:24.512843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 486/960] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:25.374818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6b54-f784-464e-8436-8ac7a9bc60f3 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:25.375376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6b54-f784-464e-8436-8ac7a9bc60f3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:25.375376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6b54-f784-464e-8436-8ac7a9bc60f3 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:25.377031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 475/961] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:25.382627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:25.383205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:25.383205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:25.401555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:25.402839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:25.482734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 487/962] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:25.506708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d6b54-f784-464e-8436-8ac7a9bc60f3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:25.611076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d6b54-f784-464e-8436-8ac7a9bc60f3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:25.646159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:25.646888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:25.647166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:25.647436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:25.657986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:25.667065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:25.669259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:25.671208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 476/963] 10.222.0.84 () {56 vars in 1120 bytes} [Fri May 13 18:14:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:25.676170 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:25.779160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38450978-7ca9-40e7-acbc-e7004548b433 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:25.814501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:25.815183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:25.815466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:25.815742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:25.816506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:25.816815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:25.818218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:25.828212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 488/964] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:14:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:25.834922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:25.939358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1105-c523-4c99-8510-c4bb12ac73f7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:25.975000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:25.975795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:25.976073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:25.976345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:25.987594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:25.989052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:26.007005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:26.008079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:26.009736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:26.009736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:26.009736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:26.009736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:26.009736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 477/965] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:26.016151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.118607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b32e5-1cc7-434f-a26c-82adb56cbbe8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:26.153113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:26.154196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.154701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.155217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.156152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:26.156662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:26.158302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.173280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 489/966] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:26.182973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.286084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c2de-fec2-4157-8a41-938ae30d7c6f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:26.320245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:26.321990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.322616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.323087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.331118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:26.332850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a8ac717a-f1c0-4e67-9c5b-82db0ca42a1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:26.348530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:26.349521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 18:14:26.350484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:26.353605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 478/967] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:26.359545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.361539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde6b5-d04a-4b2f-8e99-27328cd01863 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.361849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde6b5-d04a-4b2f-8e99-27328cd01863 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.362133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde6b5-d04a-4b2f-8e99-27328cd01863 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.363728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 479/968] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:26.369140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.369425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.369703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.387125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:26.388310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:26.466207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 480/969] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:26.480517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e49d3-9d2a-4807-ac61-44f5314226a9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:26.484637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.517684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:26.518743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.519225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.519696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.520737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:26.521268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:26.522917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.542648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 490/970] 10.222.0.84 () {56 vars in 1149 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:26.550010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.592786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c93c0-3b9b-4d15-9b91-ebd75b860c63 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:26.631310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:26.632117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.632400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.632672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.633338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:26.635566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f885e83c-0e09-45c9-a7b4-672a3f7e6c5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:26.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:26.648786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:26.650193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 481/971] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:26.651630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948be7-707b-4d85-81eb-fda8a349c246 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.651630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948be7-707b-4d85-81eb-fda8a349c246 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.651914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948be7-707b-4d85-81eb-fda8a349c246 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.653205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 482/972] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:26.656459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948be7-707b-4d85-81eb-fda8a349c246 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.663840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847daa7a-4e6a-47ce-bcb6-d37fad115521 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:26.701873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:26.702526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.702806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.703077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.761316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948be7-707b-4d85-81eb-fda8a349c246 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:26.774242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:26.775729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.796781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:26.797359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.797635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.797935 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.798638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:26.798941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:26.800290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e6550-75f6-4e30-bfa2-bf639188ac0c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:26.809825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 483/973] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:26.809825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:26.809825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:26.809825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:26.824650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:26.825825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:26.887348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 491/974] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:26.887348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.898370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 484/975] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:26.899604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:26.987877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f36ca-e81b-4271-85b0-6d4429895a44 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.002098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f216cb-0237-4478-be0d-83da93a391e7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.020601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.021253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.021530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.021819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.022522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:27.022822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.024235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.029068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 492/976] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:27.029652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.036255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.037039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.037323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.037595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.048343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.049706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-26efecb2-3288-4ddd-b332-2a0c73478ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:27.067273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:27.068438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:27.069405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:27.069405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:27.069405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:27.069405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:27.069405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 485/977] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:27.069745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283e651-47e8-41ca-b047-2891eb321c9c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.070044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283e651-47e8-41ca-b047-2891eb321c9c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.070317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283e651-47e8-41ca-b047-2891eb321c9c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.072179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 486/978] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:27.072887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283e651-47e8-41ca-b047-2891eb321c9c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.128813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5af09-d52c-4e72-aaa7-69a8d2318d49 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.163859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.164519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.165353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.165629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.166341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.168093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.169462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING keystone.server.flask.common [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 18:14:27.171748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283e651-47e8-41ca-b047-2891eb321c9c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.181524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.sql.core [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 18:14:27.181524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 18:14:27.181524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [parameters: {'user_id': '732bce241057403ba800d259eb7e5117', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 18:14:27.181524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79983) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result = self._query(query) May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application conn.query(q) May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result.read() May 13 18:14:27.188851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 18:14:27.189749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application next(self.gen) May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application yield resource May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application next(self.gen) May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.session.rollback() May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.force_reraise() May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise self.value May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application session.commit() May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 18:14:27.190790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._prepare_impl() May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.session.flush() May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._flush(objects) May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application compat.raise_( May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application flush_context.execute() May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rec.execute(self) May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 18:14:27.191721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result = connection._execute_20( May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 18:14:27.192632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result = self._query(query) May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application conn.query(q) May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application result.read() May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 18:14:27.193499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [parameters: {'user_id': '732bce241057403ba800d259eb7e5117', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:27.194665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 13 18:14:27.196674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 493/979] 10.222.0.84 () {60 vars in 1131 bytes} [Fri May 13 18:14:27 2022] POST /identity/v3/users => generated 160 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:27.199525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.209678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.210370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.210648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.210930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.212422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] RBAC: Adding query filter params (interface=admin, service_id=37f33e10ec1044ecb1216db53f8e13d2, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:27.212733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.214141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca090f7-a948-4115-825d-de093af8dc25 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.219298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 487/980] 10.222.0.84 () {56 vars in 1249 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/endpoints?service_id=37f33e10ec1044ecb1216db53f8e13d2&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:27.220560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.220847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.221124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.238637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:27.239832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:27.294412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b06e0f-e80c-4e87-bf0f-91bc32f199c3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.308543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 488/981] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:27.309392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.340915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.342005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.342470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.342925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.344163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:27.344554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.347283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.372363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 494/982] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:27.373837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.435668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4aa27-678d-49f5-aa78-84e90af9f029 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.470581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.471380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.471659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.471934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.480437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.481468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c524fb-ea86-4a43-a69a-30061cd612ff None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.481944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:27.497270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:27.498570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 18:14:27.499863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:27.501965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 489/983] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:27.502965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.515350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.516015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.516297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.516573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.517259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.518662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.527746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 495/984] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:14:27.528873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.616819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eb919-34cd-4cf2-b3a1-2fdf0db3905d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.644456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f786b-c7e2-4ae5-a38c-bfc9e5761d52 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.656811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.657599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.657987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.658360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.659176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.660586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.676109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 490/985] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:14:27 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:27.676710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.697627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.698564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.698847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.699117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.707242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.708878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:27.728822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:27.729856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:27.730770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 496/986] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:27.736743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:27.819121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc4dc-90a4-4d12-a2fc-fb1479b7069a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.864061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.865636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.866491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.867058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.868868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:27.869811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.871928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.879587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001a08-c897-4622-bd2f-e9d69aa45ba2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:27.911497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 491/987] 10.222.0.84 () {56 vars in 1101 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:27.920221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:27.920977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:27.921261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:27.921537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:27.922403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:27.922716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:27.924191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b9999-6f90-47e3-a388-e10c82e77e20 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:27.939700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 497/988] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:27.947053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:28.057507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb944-c610-41b1-955f-782e0a199ead None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:28.095742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:28.096411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:28.096690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:28.096968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:28.097833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] RBAC: Adding query filter params (role.id=bda6652e7fdb424194123022cf88391e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=31f30b58e64c45beb61a9ec51c9526da) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:28.098155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:28.099605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67c15f-390e-403e-a7f8-e8e585ab91fd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:28.107147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 492/989] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:27 2022] GET /identity/v3/role_assignments?user.id=31f30b58e64c45beb61a9ec51c9526da&scope.project.id=31dac20388d84281bab425701bac98be&role.id=bda6652e7fdb424194123022cf88391e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:29.974999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a1992-6935-40df-9770-6110ff51d38c None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:29.975599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a1992-6935-40df-9770-6110ff51d38c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:29.975599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a1992-6935-40df-9770-6110ff51d38c None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:29.977035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 498/990] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:29.982840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:29.983245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:29.983433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.007123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:30.008303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:30.062628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0454f-d8b2-4518-8689-325d80f54127 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.062970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0454f-d8b2-4518-8689-325d80f54127 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.063184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0454f-d8b2-4518-8689-325d80f54127 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.064658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 499/991] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:30.069515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.069743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.070021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.076261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 493/992] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:30.088251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:30.089757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:30.099238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.161825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 500/993] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:30.184186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.200941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee539be0-6f58-4ca0-9829-55a2c4ad7c4e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.236102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.236818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.237096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.237626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.238311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.240090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:30.252495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:30.253570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:30.254882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 494/994] 10.222.0.84 () {56 vars in 1126 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:30.260405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.291928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c349a-c519-4a08-b244-25e655b1e8c3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.328230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.329060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.329347 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.329621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.330345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.331765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:30.345128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:30.346314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:30.347207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 501/995] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:30.353311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.376571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862527-f795-4005-98eb-671f411bdbc1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.412084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.412743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.413024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.413296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.414034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:30.414340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.415834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.420675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 495/996] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:30.426262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.463076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c287b9-2681-41a4-adcf-f3523295a2ed None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.501003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.501591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.501900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.502211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.503116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:30.503772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.505101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a2f5c-f161-44bb-b6a1-ff4e867d6084 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.511104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 502/997] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:30.514651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6334db-1377-4e86-8039-e10479acade4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.514939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6334db-1377-4e86-8039-e10479acade4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.515216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6334db-1377-4e86-8039-e10479acade4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.516471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 503/998] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:30.517157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6334db-1377-4e86-8039-e10479acade4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.534716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7782c0b-3ce9-4099-a133-b31c77f9904a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.567459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.568120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.568403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.568685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.569388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:30.569695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.571727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311013f-b474-415f-8f9f-e8a080fa86f6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.576430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 496/999] 10.222.0.84 () {56 vars in 1122 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:30.577738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.578107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.578324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.595453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:30.596651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:30.627190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6334db-1377-4e86-8039-e10479acade4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.662261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.662902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.663182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.663446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.664152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:30.664287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 497/1000] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:30.664449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.665774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.666551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.671923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 504/1001] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:30.677673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.766556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae2d52-0f2a-4bf1-bb5a-bb51bc25b5d0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.781420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5576cb-3f90-4f43-851e-e34fd749f139 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.816736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.817766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.818262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.818673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.819928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.822374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.833517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:30.834212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:30.834497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:30.834768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:30.835562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] RBAC: Adding query filter params (interface=public, service_id=f84b42358931471b85018811ffc71e6e, region_id=RegionOne) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:30.835870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:30.837300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:30.842013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 498/1002] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:30.847494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 505/1003] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/endpoints?service_id=f84b42358931471b85018811ffc71e6e&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:30.847698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.849084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:30.961554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d796-51b3-42be-91a5-977ae0c34075 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.968011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560cda-37e0-45a3-a2e9-a266f8454524 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:30.999817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:31.000510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:31.000781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:31.001063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:31.001763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:31.003217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:31.005187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:31.006095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:31.006397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:31.006677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] PATH_INFO: `/v3/services/image` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:31.007347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:31.009251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:31.011699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 506/1004] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:31.025204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:31.026326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:31.027207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:31.028720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 499/1005] 10.222.0.84 () {56 vars in 1105 bytes} [Fri May 13 18:14:30 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:31.033082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:31.143707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed27f1-0ae2-4524-b357-0af08312162b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:31.178531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:31.179202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:31.179480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:31.179755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:31.181009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] RBAC: Adding query filter params (name=image) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:31.181313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:31.182728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc9a82-72bc-4aac-9c7c-d7639e6f7cff None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:31.188201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 507/1006] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:31.194971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:31.298509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fdda4-e220-436d-8bac-255f3e0791f0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:31.331755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:31.332431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:31.332713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:31.332990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:31.333726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] RBAC: Adding query filter params (type=image) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:31.334070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:31.335425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e7ba2-fd53-45e4-8dfc-422c10373127 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:31.340928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 500/1007] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:33.187275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa9de-2139-4749-a2a5-42d90ade24ec None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.187828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa9de-2139-4749-a2a5-42d90ade24ec None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.187828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa9de-2139-4749-a2a5-42d90ade24ec None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.189192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 508/1008] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:33.194620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95db27-8c5c-4f40-8471-36398391bc93 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.195047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95db27-8c5c-4f40-8471-36398391bc93 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.195216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95db27-8c5c-4f40-8471-36398391bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.213396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0c95db27-8c5c-4f40-8471-36398391bc93 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:33.214624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0c95db27-8c5c-4f40-8471-36398391bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:33.279817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 501/1009] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:33.303684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa9de-2139-4749-a2a5-42d90ade24ec None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.310829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836f01-1196-4551-9dfd-0108681548e1 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.311122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836f01-1196-4551-9dfd-0108681548e1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.311399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836f01-1196-4551-9dfd-0108681548e1 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.312922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 502/1010] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:33.317829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.318128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.318414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.334795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:33.335946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:33.404555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 503/1011] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:33.406845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa9de-2139-4749-a2a5-42d90ade24ec None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:33.428303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.444229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:33.444911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.445189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.445461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.446731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:33.448165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:33.449982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 509/1012] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:33.455377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.536051 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12117a77-98ec-427b-85ca-39bdd2d149df None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:33.564421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678b2d9-8651-4bab-adfc-98a74824ac10 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:33.569567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:33.570429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.570812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.571088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] PATH_INFO: `/v3/services/compute` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.571736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:33.573100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:33.584708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:33.585789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:33.587305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 504/1013] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:33.592598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.604018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2df6-dbc1-4fdc-8928-0be2320ae740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:33.604715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2df6-dbc1-4fdc-8928-0be2320ae740 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.604969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2df6-dbc1-4fdc-8928-0be2320ae740 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.605246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2df6-dbc1-4fdc-8928-0be2320ae740 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.605989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f2df6-dbc1-4fdc-8928-0be2320ae740 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:33.607419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f2df6-dbc1-4fdc-8928-0be2320ae740 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:33.633620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 510/1014] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:14:33 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:14:33.634987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5338-a0eb-49b2-bf0f-80c22a5ee1fa None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.635274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5338-a0eb-49b2-bf0f-80c22a5ee1fa None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.635553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5338-a0eb-49b2-bf0f-80c22a5ee1fa None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.636993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 511/1015] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:33.642673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.643009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.643221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.661174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:33.662456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:33.702209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3022ce-1070-490e-b3ba-350ba2cfb00e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:33.735831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 512/1016] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:33.739737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:33.740505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.740704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.740975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.741690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:33.742028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:33.743823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:33.749371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 505/1017] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:33.755474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.760514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.865674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8c01a-cb10-45a3-911c-98b7fb3d9213 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:33.869180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916e34-7121-4190-a9cd-2903305e3556 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:33.903255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:33.903946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.904225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.904497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.904835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376741f5-309a-4906-beb7-3bb737816013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:33.905205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:33.905512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:33.905622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376741f5-309a-4906-beb7-3bb737816013 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:33.905823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376741f5-309a-4906-beb7-3bb737816013 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:33.906185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376741f5-309a-4906-beb7-3bb737816013 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:33.906893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376741f5-309a-4906-beb7-3bb737816013 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:33.906988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:33.908280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376741f5-309a-4906-beb7-3bb737816013 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:33.912255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 513/1018] 10.222.0.84 () {56 vars in 1112 bytes} [Fri May 13 18:14:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:33.918434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:33.923375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 506/1019] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:14:33 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:14:34.029343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f54d6-a4dc-4bc1-bb65-0d75d103a904 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:34.073275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5a8d-e35d-4694-80a4-5c3aecf50b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:34.073977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5a8d-e35d-4694-80a4-5c3aecf50b55 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:34.074265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5a8d-e35d-4694-80a4-5c3aecf50b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:34.074544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5a8d-e35d-4694-80a4-5c3aecf50b55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:34.075302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5a8d-e35d-4694-80a4-5c3aecf50b55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:34.076684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5a8d-e35d-4694-80a4-5c3aecf50b55 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:34.096586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 514/1020] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:14:35.935695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008424-2a24-44a6-afee-2488cbeabfe7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:35.936234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008424-2a24-44a6-afee-2488cbeabfe7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:35.936234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008424-2a24-44a6-afee-2488cbeabfe7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:35.939751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 507/1021] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:35.943525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:35.943977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:35.944152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:35.962227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:35.963436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:36.036198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 515/1022] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:36.062029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008424-2a24-44a6-afee-2488cbeabfe7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.166418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008424-2a24-44a6-afee-2488cbeabfe7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.200589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68bc1a-3ea1-4fd7-b400-d7dcc62fc968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.201301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68bc1a-3ea1-4fd7-b400-d7dcc62fc968 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.201577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68bc1a-3ea1-4fd7-b400-d7dcc62fc968 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.201876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68bc1a-3ea1-4fd7-b400-d7dcc62fc968 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.203028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68bc1a-3ea1-4fd7-b400-d7dcc62fc968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:36.204443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68bc1a-3ea1-4fd7-b400-d7dcc62fc968 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:36.210673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 508/1023] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:36.212892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.250882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8780a-2b4d-445a-a560-dd55f592da30 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.251118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8780a-2b4d-445a-a560-dd55f592da30 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.251366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8780a-2b4d-445a-a560-dd55f592da30 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.252820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 509/1024] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:36.259683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.260031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.260242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.280548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:36.281736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:36.319831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fb7d6-610c-4e18-9a5e-ec2e9aeafb92 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.356840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 510/1025] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:36.359804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e748b-8a4a-4683-914b-ceca6a6ad724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.360617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e748b-8a4a-4683-914b-ceca6a6ad724 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.361025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e748b-8a4a-4683-914b-ceca6a6ad724 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.361429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e748b-8a4a-4683-914b-ceca6a6ad724 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.362622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e748b-8a4a-4683-914b-ceca6a6ad724 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:36.364181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e748b-8a4a-4683-914b-ceca6a6ad724 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:36.381431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.389822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 516/1026] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:14:36 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:14:36.444999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24b3ed-572f-4f24-a7e0-ae7a40f42e5c None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.445293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24b3ed-572f-4f24-a7e0-ae7a40f42e5c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.445865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24b3ed-572f-4f24-a7e0-ae7a40f42e5c None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.447588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 517/1027] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:36.453522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.453727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.454029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.479224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:36.480470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:36.496385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ba6e7-6e72-4424-abb9-312a7d49fc33 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.534125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.535244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.535753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.536217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] PATH_INFO: `/v3/services/image` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.537063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:36.538666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:36.551204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:36.552287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:36.553138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:36.553908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 518/1028] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:36.554499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 511/1029] 10.222.0.84 () {56 vars in 1105 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:36.560789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.577545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.679687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527655d7-73dd-49c9-aa53-c2c8819a2a0b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.685421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060a19-d507-47db-ac53-c55b528ad161 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.714706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.715360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.715646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.715919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.716640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] RBAC: Adding query filter params (name=image) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:36.716949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:36.718401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:36.719592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.720401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.720682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.720957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.728147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 519/1030] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:36.729161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.736596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:36.745420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:36.746483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:36.747472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:36.749137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 512/1031] 10.222.0.84 () {56 vars in 1120 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:36.752645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.839986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b771df4-3d25-4e6b-a489-4469b7515e70 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.876757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.877423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.877704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.878007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.878719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:36.879024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:36.880380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:36.884740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339254-5915-4857-810c-66619af26eb7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:36.886077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 520/1032] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:36.891622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:36.921187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:36.921881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:36.922163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:36.922435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:36.923176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:36.923480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:36.924839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:36.933952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 513/1033] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:36.939230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:37.001025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c133d-c44a-4173-a312-2b92091dc8c9 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.034592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.035249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.035528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.035801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.036629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] RBAC: Adding query filter params (interface=public, service_id=a3f017d7340d44d3b484fc3882af9d29, region_id=RegionOne) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:37.036889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.038272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.048676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 521/1034] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/endpoints?service_id=a3f017d7340d44d3b484fc3882af9d29&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:37.048881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f732d-f2e0-4334-90be-024c4301431b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.049999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:37.080124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.081222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.081681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.082140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.094536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.096271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:37.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:37.116664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:37.118132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:37.118132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:37.118132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:37.118132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:37.120299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 514/1035] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:37.126129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:37.153206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2935f-5fd6-45e3-aa72-ccde665ca51f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.188171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.188839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.189126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.189437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.190160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.191572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.198657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 522/1036] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:14:37 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:14:37.269405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f097-7990-4224-9002-8188f79429d6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.302880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.303575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.303863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.304145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.305920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:37.306458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.307886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.322782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 515/1037] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:37.328304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:37.435021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf3bf4-a12d-4089-a661-6b780c12a8e6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.470650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.471434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.471710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.471977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.482140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.483599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:37.497853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:37.498853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:37.500418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 523/1038] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:14:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:37.504667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:37.608499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fc32b-d58a-4aac-bce8-55d4f7531226 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.643007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.643678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.643957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.644229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.645067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:37.645375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.646821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.668625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 516/1039] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:14:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:37.669849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:37.768819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9e4c-9def-4351-b5dc-a241cd5c023d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:37.802305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:37.802957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:37.803239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:37.803512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:37.873369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:37.874770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:37.971332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 524/1040] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:37.977655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:38.073712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62604-68e3-4fca-8564-68966e050c3e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:38.107852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:38.108645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.108927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.109203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.120243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:38.121701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:38.139504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:38.141262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:38.143530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:38.143530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:38.143530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:38.143530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:38.144205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 517/1041] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:38.146283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:38.249079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a94a56-8ec4-45fc-84e4-9a97fb71a542 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:38.284618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:38.285599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.286113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.286590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.287520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:38.288011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:38.290066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:38.308387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 525/1042] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:38.309907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:38.412425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4d2b-ab2a-45c6-bfc6-c47c4db93fbc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:38.446371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:38.447577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.448079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.448570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.455759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:38.458009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:38.475706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:38.481573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:38.482545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 518/1043] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:38.483074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:38.587944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53f27-8425-44a7-99c5-f6ae84dbe100 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:38.621315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:38.622000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.622284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.622557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.623345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:38.623654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:38.625076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ceed-53bd-4d22-af88-b6a7c22ff660 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:38.637193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 526/1044] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:38.642953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:38.730645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1054d9-231a-49f1-8b35-b7410ce00358 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.730958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1054d9-231a-49f1-8b35-b7410ce00358 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.731148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1054d9-231a-49f1-8b35-b7410ce00358 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.732540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 527/1045] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:38.737928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.738214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.738491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.755371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:38.756557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:38.759570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678e91-c12e-4bf1-ac35-1ebad134aa80 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:38.794834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:38.795491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:38.795773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:38.796050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:38.796899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] RBAC: Adding query filter params (role.id=bda6652e7fdb424194123022cf88391e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=b5e358b1f53b408f8f1e9661ac754c39) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:38.797211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:38.798673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:38.804702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 519/1046] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:38 2022] GET /identity/v3/role_assignments?user.id=b5e358b1f53b408f8f1e9661ac754c39&scope.project.id=31dac20388d84281bab425701bac98be&role.id=bda6652e7fdb424194123022cf88391e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:38.830366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 528/1047] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:38.856257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:38.965863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4c75-ab00-418b-8cbf-346fe3e0516d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.001254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.002084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.002363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.002642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.013367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:39.020990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:39.022217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:39.023105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 520/1048] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:39.030612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.128130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de3757-0cd9-4f45-a6fa-b30e6ae03ea3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.162160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.162825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.163093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.163646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.165133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:39.165501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.166831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.175195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 529/1049] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:39.181547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.281205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57f47-c524-4bc1-a99e-3f1cba77ffd6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.319287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0d137-0dda-43e3-bfca-f8a69727e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.320184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0d137-0dda-43e3-bfca-f8a69727e64b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.321244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0d137-0dda-43e3-bfca-f8a69727e64b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.321529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0d137-0dda-43e3-bfca-f8a69727e64b None admin] PATH_INFO: `/v3/users/f9d0f01e9bfb44589044afda267f354f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.336595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0d137-0dda-43e3-bfca-f8a69727e64b None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0f01e9bfb44589044afda267f354f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.338068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0d137-0dda-43e3-bfca-f8a69727e64b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.339965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 521/1050] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/users/f9d0f01e9bfb44589044afda267f354f => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:39.345590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.443500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035b7a8-d9c2-4d64-b04b-681617843a23 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.479476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.480141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.480421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.480692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.497874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b092c-70a9-4f3c-adc2-b178d820c58f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.498208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b092c-70a9-4f3c-adc2-b178d820c58f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.498459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b092c-70a9-4f3c-adc2-b178d820c58f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.499924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 522/1051] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:39.504697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.504977 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.505254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.522467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:39.523683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:39.551214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.552603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.589365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 523/1052] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:39.611524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.653261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 530/1053] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:39.659094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.716960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a990634-8d7c-4f67-b884-557c3a1dd194 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.749400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.750208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.750490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.750759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] PATH_INFO: `/v3/services/image` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.751403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.752751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.755531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32428-990a-4138-a3c0-2ee9c429e1d0 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:39.764687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:39.765886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:39.766759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 524/1054] 10.222.0.84 () {56 vars in 1105 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:39.772009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.795365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.796224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.796524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.796777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.798075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] RBAC: Authorizing `identity:get_project(project_id=ada60c4167d94cad895451fcea2b0b27)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.799718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.801779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 531/1055] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:39.807872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.878309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f87d86-c2e1-4639-b261-f4378e9bc788 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.912183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b135da-4df0-43fb-b0c6-563b8f3e106d None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:39.914665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.915502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.915807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.916084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.916830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] RBAC: Adding query filter params (name=image) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:39.917104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.918515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.928383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 525/1056] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:39.929437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:39.950377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:39.951234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:39.951716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:39.952135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:39.953297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=ada60c4167d94cad895451fcea2b0b27, user.id=f9d0f01e9bfb44589044afda267f354f) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:39.953736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:39.955498 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:39.963470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 532/1057] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/role_assignments?user.id=f9d0f01e9bfb44589044afda267f354f&scope.project.id=ada60c4167d94cad895451fcea2b0b27&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:40.046911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815260-7ec8-47ee-95e2-535d511b1744 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:40.084218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:40.084900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:40.085184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:40.085462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:40.086747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] RBAC: Adding query filter params (type=image) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:40.087053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:40.088441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998364b-29e9-461e-8d2a-05afab27b12b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:40.094301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 526/1058] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:40.100242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:40.203162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf6bc-2069-4f17-be3d-eccc37edd0e0 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:40.236107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f547764-31f6-4c91-a054-d69715aa3e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:40.236767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547764-31f6-4c91-a054-d69715aa3e13 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:40.237309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547764-31f6-4c91-a054-d69715aa3e13 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:40.237610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547764-31f6-4c91-a054-d69715aa3e13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:40.238366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f547764-31f6-4c91-a054-d69715aa3e13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:40.239718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f547764-31f6-4c91-a054-d69715aa3e13 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:40.265818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 533/1059] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:14:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:41.074102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4202ab-a91c-4fb7-adc5-0fe64e210319 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.074629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4202ab-a91c-4fb7-adc5-0fe64e210319 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.074709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4202ab-a91c-4fb7-adc5-0fe64e210319 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.076194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 527/1060] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:41.081284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.081645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.082033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.099893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:41.101073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:41.176592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 534/1061] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:41.200065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4202ab-a91c-4fb7-adc5-0fe64e210319 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:41.304347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4202ab-a91c-4fb7-adc5-0fe64e210319 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:41.339320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:41.340048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.340333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.340615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.350866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:41.360028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:41.360988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:41.362606 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:41.363757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 528/1062] 10.222.0.84 () {56 vars in 1120 bytes} [Fri May 13 18:14:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:41.368366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:41.467434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8209b65-6555-4ccf-8128-d367ec708a28 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:41.502757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:41.503433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.503717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.503992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.504742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:41.505050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:41.506446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:41.520173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 535/1063] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:14:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:41.521519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:41.621265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078498-3949-4ee9-87b0-8c1a404ec2ac None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:41.653818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:41.654603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.654885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.655157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.665649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:41.667135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:41.684335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:41.685296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:41.686274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:41.686274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:41.686274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:41.686274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:41.691693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 529/1064] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:41.691822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:41.791304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393f7be-e569-4b3b-9057-44689a27094c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:41.826111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:41.826778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.827061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.827338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.828069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:41.828374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:41.829745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:41.847251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 536/1065] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:41.848871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:41.947370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc26e2-ca3d-4c40-a6c3-c92e786cf0c8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:41.981425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:41.982243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:41.982521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:41.982791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:41.990402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:41.991831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:42.005822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:42.006802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:42.008381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:42.010128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 530/1066] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:42.013548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.117925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c27c11-0329-46bb-aa14-c4c9eb572104 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.152868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.153538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.153851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.154137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.154980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:42.155293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.156705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693374a-aa83-4114-9e71-ccff1e58f005 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.179008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 537/1067] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:42.181503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.233098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ffb7a-dba6-4433-9b57-c9e493891249 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.233400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ffb7a-dba6-4433-9b57-c9e493891249 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.233581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ffb7a-dba6-4433-9b57-c9e493891249 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.235636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 538/1068] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:42.241160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.241465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.241742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.262411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:42.263597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:42.289240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0448-c9f5-4396-98ee-f24d33847702 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.325707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.326535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.326816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.327090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.333301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 539/1069] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:42.339382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.340848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.357041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:42.358322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:42.359340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:42.360347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:42.360347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:42.360347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:42.360347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:42.360347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 531/1070] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:42.365571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.463504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2253a74-c824-4721-a312-a9d6a14efae5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.471446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a007f-37bb-48f2-8a11-a5aa70336aa6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.505584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.506422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.506733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.506975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.507358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.508752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.509035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.509339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.510228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:42.510474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.511755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.517840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:42.525357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 532/1071] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:42.525743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:42.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:42.527683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 540/1072] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:42.533041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.533472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.643645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee371a9-4248-4767-864a-47ec95ed459f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.649913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccbb5-a535-4a9d-85a7-1e72d57bb09c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.676123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.676902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.677182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.677459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.683285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.683949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.684229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.684505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.684598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.685254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:42.685560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.686004 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.686980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8283d-96e5-48a2-9912-45958d24808d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.694922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 541/1073] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:42.697089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867e2e-2a07-4373-aa47-4bcb32bfc7af None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.697380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867e2e-2a07-4373-aa47-4bcb32bfc7af None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.697662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867e2e-2a07-4373-aa47-4bcb32bfc7af None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.699096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 542/1074] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d3536d3b-b9ce-4736-b010-ef52af7da332 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:42.701466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:42.702647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:42.703593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:42.704045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867e2e-2a07-4373-aa47-4bcb32bfc7af None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.706395 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 533/1075] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:42.707357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.707716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.708070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.725463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:42.727558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:42.795039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 534/1076] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:42.795783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.803683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867e2e-2a07-4373-aa47-4bcb32bfc7af None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.839587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.839891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.840176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.840452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] PATH_INFO: `/v3/users/f9d0f01e9bfb44589044afda267f354f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.841675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0f01e9bfb44589044afda267f354f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.843143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.844782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 543/1077] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/users/f9d0f01e9bfb44589044afda267f354f => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:42.849490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.893500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f5f6a-f5a1-4835-96fb-f152b1d6c5b6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.926404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.927062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.927345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.927623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:42.928411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:42.928718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:42.930591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:42.939298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2604d-0a7f-4a88-8c52-094d7a364e42 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:42.941988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 535/1078] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:42.942830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:42.973718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:42.974403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:42.974686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:42.974959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:43.038547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fd66f-b394-4034-b813-cc066acf08c8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:43.040713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:43.042189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:43.071192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:43.072045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:43.072327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:43.073660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:43.073921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] RBAC: Authorizing `identity:get_project(project_id=ada60c4167d94cad895451fcea2b0b27)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:43.075242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:43.076960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 536/1079] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:43.077696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:43.141641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 544/1080] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:43.142507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:43.178492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c82612-c6a6-4867-8df4-352b0b2a433a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:43.212666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:43.213549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:43.213855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:43.214143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/b5e358b1f53b408f8f1e9661ac754c39/roles/bda6652e7fdb424194123022cf88391e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:43.216356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=b5e358b1f53b408f8f1e9661ac754c39, role_id=bda6652e7fdb424194123022cf88391e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:43.217780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:43.231956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 537/1081] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:43 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/b5e358b1f53b408f8f1e9661ac754c39/roles/bda6652e7fdb424194123022cf88391e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:14:43.232767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:43.237961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f391005-b035-4b5a-9547-5649c97aefed None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:43.276060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:43.276964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:43.277245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:43.277519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27/users/f9d0f01e9bfb44589044afda267f354f/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:43.280246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] RBAC: Authorizing `identity:create_grant(project_id=ada60c4167d94cad895451fcea2b0b27, user_id=f9d0f01e9bfb44589044afda267f354f, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:43.281690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:43.305812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 545/1082] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:43 2022] PUT /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27/users/f9d0f01e9bfb44589044afda267f354f/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:14:43.357979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264469bc-5c8a-4cc4-9870-a98994e909b2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:43.397649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:43.399254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:43.399540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:43.399868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:43.412574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:43.414285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-edd77c35-c793-4dac-89d4-556dc5fdf337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:43.432873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:43.434252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:43.435206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:43.435206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:43.435206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:43.435206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:43.438655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 538/1083] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:43.441702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:43.553282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36839b5c-0a29-4bc3-b530-4f54e5fa1361 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:43.586902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:43.587570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:43.587847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:43.588124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:43.588844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:43.589153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:43.590537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7642d4b-b29b-44da-b9c9-0cb58b133464 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:43.608237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 546/1084] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:45.526940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191637ec-bf19-48f0-9c72-bca1cdd34a6e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.527492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191637ec-bf19-48f0-9c72-bca1cdd34a6e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.527492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191637ec-bf19-48f0-9c72-bca1cdd34a6e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.529010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 539/1085] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:45.534120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.534543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.534718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.551717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:45.552888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab4cee-da8b-4c39-834f-38d8e2f584a5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.553010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:45.553176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab4cee-da8b-4c39-834f-38d8e2f584a5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.553453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab4cee-da8b-4c39-834f-38d8e2f584a5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.555481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 540/1086] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:14:45.560765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.561054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.561334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.578821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:45.580046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:45.619732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 547/1087] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:45.643714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:45.648188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 541/1088] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 18:14:45.672078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:45.736265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cc25e-5852-46f0-8bf9-f528e5f7f0e3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:45.767352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002175-e1f0-4f2f-9ee5-76bfb8f28227 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:45.769035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:45.769865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.770149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.770420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.780508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:45.789326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:45.790342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:45.791277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 548/1089] 10.222.0.84 () {56 vars in 1120 bytes} [Fri May 13 18:14:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:45.796505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:45.801693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:45.802522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.802804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.803080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.814948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:14:45.822867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:45.824122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:45.825075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 542/1090] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:45.829914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:45.897105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2c4c-c960-440e-9097-b89900dfda40 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:45.924153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b35ff-0e62-45dd-8e25-256f51af0f78 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:45.929269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:45.930024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.930280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.930555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.931327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:45.931607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:45.932984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:45.941514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 549/1091] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:14:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:45.948322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:45.959522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:45.960198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:45.960476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:45.961405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:45.962145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:45.962453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:45.963827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:45.971771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 543/1092] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:45.977506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.045116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3b06-d338-492e-9c2f-0edaa243203f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.072277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731fef2-de83-4c31-a280-c0f5ebfe7544 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.077598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.078423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.078710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.078989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.090613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.092059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.105296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.106186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.106469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.106745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] PATH_INFO: `/v3/users/f9d0f01e9bfb44589044afda267f354f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.107932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0f01e9bfb44589044afda267f354f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:46.109284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:46.110328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:46.111305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:46.111305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:46.111305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:46.111305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:46.111543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.111617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 550/1093] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:46.111686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 544/1094] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:45 2022] GET /identity/v3/users/f9d0f01e9bfb44589044afda267f354f => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:46.116456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.116627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.213218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b05e-ae49-4e8b-97c8-329e140282db None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.217960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aa9dc-fb84-487d-be8f-5884b021d57e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.246140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.246798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.247083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.247360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.248081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:46.248390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.249754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.251136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.251778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.252053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.252321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.261512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 551/1095] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:46.267091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.317179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.318649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.363908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4fd3-d836-41ce-b562-f44c9c53002a None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.394544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.395359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.395641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.395924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.403356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.404783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.411383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 545/1096] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 18:14:46.417245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:14:46.418974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:46.420111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 18:14:46.421353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:14:46.424882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 552/1097] 10.222.0.84 () {56 vars in 1093 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:14:46.425559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.518817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379deaa-3920-4ad3-a07d-83fba7fdb072 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.531524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c90f1-9f19-45d0-b80f-4b5d149af400 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.553542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.554481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.555770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.556047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.557244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] RBAC: Authorizing `identity:get_project(project_id=ada60c4167d94cad895451fcea2b0b27)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.558730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.560446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 546/1098] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:46.564721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.565394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.565681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.565982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.566453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.566826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:46.567138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.568604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.585238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 553/1099] 10.222.0.84 () {56 vars in 1133 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:46.591333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:46.662258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484861f4-0e37-4316-a59c-9b63cea07b35 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.688688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6f85-131f-458a-89d0-4c952515c5a2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:46.694944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.695664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.695946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.696223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.697052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=ada60c4167d94cad895451fcea2b0b27, user.id=f9d0f01e9bfb44589044afda267f354f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:46.697357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.698805 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.704471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 547/1100] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/role_assignments?user.id=f9d0f01e9bfb44589044afda267f354f&scope.project.id=ada60c4167d94cad895451fcea2b0b27&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:46.721545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:46.722257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:46.722542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:46.722819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:46.797817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:46.799312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:46.903779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 554/1101] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 18:14:46.909631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:47.009926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ada74-6ee7-4e87-9c56-88f062576501 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:47.042863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:47.043661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:47.043946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:47.044223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:47.055584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:47.057034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:14:47.074319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:47.075259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:47.076247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:14:47.076247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:14:47.076247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:14:47.076247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:47.076247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 548/1102] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:47.081184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:47.181496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae5fb5-319c-4ad2-9923-8130c903a0f5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:47.214556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:47.215221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:47.215509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:47.215789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:47.216512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:47.216820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:47.218232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:47.230365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 555/1103] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:47.235909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:47.335117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afc6a4-7be6-47f4-8205-707491588760 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:47.368531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:47.369317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:47.369598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:47.369900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:47.376305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:47.377745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:14:47.391596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:14:47.393113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:14:47.394118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 549/1104] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:14:47.400387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:47.500463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d68f-d7f8-445f-bdd9-65665247e0ad None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:47.534372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:47.535028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:47.535313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:47.535590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:47.536377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:47.536687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:47.538163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79262453-2331-46bd-8bc6-54b1f09e3b6b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:47.551383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 556/1105] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:47.558511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:47.663026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad074c-4bbb-4583-a836-822440d8c85d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:47.696183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:47.696841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:47.697119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:47.697392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:47.698242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] RBAC: Adding query filter params (role.id=bda6652e7fdb424194123022cf88391e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=b5e358b1f53b408f8f1e9661ac754c39) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:47.698551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:47.699965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1cdc7-9db5-4589-a4b2-48d8eaa65f5a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:47.705626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 550/1106] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:47 2022] GET /identity/v3/role_assignments?user.id=b5e358b1f53b408f8f1e9661ac754c39&scope.project.id=31dac20388d84281bab425701bac98be&role.id=bda6652e7fdb424194123022cf88391e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:48.993104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbf0e-f5db-4113-8e80-978674437769 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:48.993660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbf0e-f5db-4113-8e80-978674437769 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:48.993660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbbf0e-f5db-4113-8e80-978674437769 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:48.995027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 557/1107] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:49.000196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:49.000621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:49.000746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:49.016842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:49.018018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:49.082324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 551/1108] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:49.107803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbbf0e-f5db-4113-8e80-978674437769 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:49.205167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbbf0e-f5db-4113-8e80-978674437769 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:49.237428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2c461-3f6f-47b9-bb5c-332a7cc78d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:49.238383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2c461-3f6f-47b9-bb5c-332a7cc78d0a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:49.238662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2c461-3f6f-47b9-bb5c-332a7cc78d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:49.238936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2c461-3f6f-47b9-bb5c-332a7cc78d0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:49.240107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2c461-3f6f-47b9-bb5c-332a7cc78d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:49.241524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2c461-3f6f-47b9-bb5c-332a7cc78d0a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:49.243798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 558/1109] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:14:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:49.249438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:49.341579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ee1cb-c7af-4f79-8364-8fc1fe4144f1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:49.373442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944e6b-04d2-4dfb-820b-10b627c4daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:49.374129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944e6b-04d2-4dfb-820b-10b627c4daf1 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:49.374411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944e6b-04d2-4dfb-820b-10b627c4daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:49.374684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944e6b-04d2-4dfb-820b-10b627c4daf1 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:49.375378 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9944e6b-04d2-4dfb-820b-10b627c4daf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:49.376806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9944e6b-04d2-4dfb-820b-10b627c4daf1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:49.396878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 552/1110] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:14:49 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:14:51.675553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df920-92a8-4535-aba8-f00ff8a482bf None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:51.676082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df920-92a8-4535-aba8-f00ff8a482bf None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:51.676082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df920-92a8-4535-aba8-f00ff8a482bf None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:51.677438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 559/1111] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:51.683397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:51.683831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:51.683925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:51.700178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:51.701327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:51.765497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 553/1112] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:51.788902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df920-92a8-4535-aba8-f00ff8a482bf None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:51.885694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df920-92a8-4535-aba8-f00ff8a482bf None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:51.918721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:51.919567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:51.919842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:51.920109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] PATH_INFO: `/v3/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:51.921550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] RBAC: Authorizing `identity:get_role(role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:51.922930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:51.924281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 560/1113] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:51 2022] GET /identity/v3/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:51.930225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:52.022612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a882168-5b1a-452d-8c6e-ea11bfc6544e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:52.054325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:52.055173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:52.055449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:52.055721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] PATH_INFO: `/v3/users/2d58078661464d538b09544031e6876e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:52.067853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=2d58078661464d538b09544031e6876e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:52.069283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:52.071463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 554/1114] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:51 2022] GET /identity/v3/users/2d58078661464d538b09544031e6876e => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:14:52.077208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:52.171464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd61845-1b61-46b2-9bc7-a8dd7f1e165e None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:52.203724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:52.204362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:52.204638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:52.204910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:52.268818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:52.270283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:52.361551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 561/1115] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:14:52.368549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:52.464436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48357c0-62d7-496d-9a57-056cfbdbb4a2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:52.498021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedd7cc-ade0-4a17-8715-4c22e8c38a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:52.498880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd7cc-ade0-4a17-8715-4c22e8c38a84 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:52.499163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd7cc-ade0-4a17-8715-4c22e8c38a84 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:52.499439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd7cc-ade0-4a17-8715-4c22e8c38a84 None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:52.500604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd7cc-ade0-4a17-8715-4c22e8c38a84 None admin] RBAC: Authorizing `identity:get_project(project_id=ada60c4167d94cad895451fcea2b0b27)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:52.502063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd7cc-ade0-4a17-8715-4c22e8c38a84 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:52.503752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 555/1116] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:14:52 2022] GET /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:52.510131 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:52.607416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e807c3-8112-4c2f-b93a-d0b1bdd490d3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:52.641320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:52.641935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:52.642220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:52.642496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:52.643328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] RBAC: Adding query filter params (role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=ada60c4167d94cad895451fcea2b0b27, user.id=2d58078661464d538b09544031e6876e) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:52.643638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:52.645052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80346276-9af1-4398-bce8-37f9e7419382 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:52.650376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 562/1117] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:52 2022] GET /identity/v3/role_assignments?user.id=2d58078661464d538b09544031e6876e&scope.project.id=ada60c4167d94cad895451fcea2b0b27&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:54.857785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23a4b-6881-4c82-ad81-9df1516dfff0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:54.858354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23a4b-6881-4c82-ad81-9df1516dfff0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:54.858354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23a4b-6881-4c82-ad81-9df1516dfff0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:54.859718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 556/1118] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:54.865194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:54.865642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:54.865737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:54.883313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:54.884490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:54.947141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 563/1119] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:54.972172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca23a4b-6881-4c82-ad81-9df1516dfff0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:55.068960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca23a4b-6881-4c82-ad81-9df1516dfff0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:55.101407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:55.102403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:55.102684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:55.102963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] PATH_INFO: `/v3/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:55.104437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] RBAC: Authorizing `identity:get_role(role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:55.105818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:55.107196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 557/1120] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:54 2022] GET /identity/v3/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:55.113322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:55.213199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5bfa2-4752-41ae-bb50-f952680221d5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:55.246030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:55.246893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:55.247172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:55.247450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] PATH_INFO: `/v3/users/2d58078661464d538b09544031e6876e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:55.248631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] RBAC: Authorizing `identity:get_user(user_id=2d58078661464d538b09544031e6876e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:55.250081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:55.251694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 564/1121] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:55 2022] GET /identity/v3/users/2d58078661464d538b09544031e6876e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:55.258010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:55.353991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148d00-3613-427d-9781-adaedafe3dbe None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:55.386675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf475b39-3936-4395-998f-4312d32f6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:55.387452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475b39-3936-4395-998f-4312d32f6dfc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:55.387735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475b39-3936-4395-998f-4312d32f6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:55.388011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475b39-3936-4395-998f-4312d32f6dfc None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:55.389176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf475b39-3936-4395-998f-4312d32f6dfc None admin] RBAC: Authorizing `identity:get_project(project_id=ada60c4167d94cad895451fcea2b0b27)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:55.390632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf475b39-3936-4395-998f-4312d32f6dfc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:55.392319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 558/1122] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:14:55 2022] GET /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:55.399406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:55.496153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd1626-3efb-4fb6-be83-b222e8ea4658 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:55.529044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73779b-90d8-4dd9-848a-717233d0c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:55.529950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73779b-90d8-4dd9-848a-717233d0c063 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:55.530227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73779b-90d8-4dd9-848a-717233d0c063 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:55.530500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73779b-90d8-4dd9-848a-717233d0c063 None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27/users/2d58078661464d538b09544031e6876e/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:55.532636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73779b-90d8-4dd9-848a-717233d0c063 None admin] RBAC: Authorizing `identity:create_grant(project_id=ada60c4167d94cad895451fcea2b0b27, user_id=2d58078661464d538b09544031e6876e, role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:55.534081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73779b-90d8-4dd9-848a-717233d0c063 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:55.546333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 565/1123] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:14:55 2022] PUT /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27/users/2d58078661464d538b09544031e6876e/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:14:57.765090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0b30-3c5f-4904-ae3a-becd8961a097 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:57.765642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0b30-3c5f-4904-ae3a-becd8961a097 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:57.765642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0b30-3c5f-4904-ae3a-becd8961a097 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:57.766974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 559/1124] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:14:57.772234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:57.773473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:57.773473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:57.790849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:14:57.792020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:14:57.855273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 566/1125] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:14:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:14:57.879114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0b30-3c5f-4904-ae3a-becd8961a097 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:57.979466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0b30-3c5f-4904-ae3a-becd8961a097 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:58.012832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:58.013678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:58.013991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:58.014270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] PATH_INFO: `/v3/roles/ac8f159fb0e6486db134f18d9f5f1d94` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:58.015794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] RBAC: Authorizing `identity:get_role(role_id=ac8f159fb0e6486db134f18d9f5f1d94)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:58.017106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:58.018510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 560/1126] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:57 2022] GET /identity/v3/roles/ac8f159fb0e6486db134f18d9f5f1d94 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:58.024338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:58.121677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e838e2-4788-4c1e-b3a2-db3bd2402f05 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:58.153250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:58.154134 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:58.154415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:58.154685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] PATH_INFO: `/v3/users/2d58078661464d538b09544031e6876e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:58.155845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] RBAC: Authorizing `identity:get_user(user_id=2d58078661464d538b09544031e6876e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:58.157559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:58.159229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 567/1127] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:14:58 2022] GET /identity/v3/users/2d58078661464d538b09544031e6876e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:58.165776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:58.260768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508774d-3e58-476c-b764-bc2846386fab None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:58.292967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:58.293528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:58.293821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:58.294107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:58.356042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:58.357459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:58.450531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 561/1128] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:14:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 18:14:58.456492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:58.552005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea606-aa5b-4373-9f9e-f60557d89f2b None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:58.584567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db1cca-c93f-4653-8048-7828066047e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:58.585550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1cca-c93f-4653-8048-7828066047e2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:58.585855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1cca-c93f-4653-8048-7828066047e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:58.586136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1cca-c93f-4653-8048-7828066047e2 None admin] PATH_INFO: `/v3/projects/ada60c4167d94cad895451fcea2b0b27` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:58.587310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db1cca-c93f-4653-8048-7828066047e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ada60c4167d94cad895451fcea2b0b27)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:58.588735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db1cca-c93f-4653-8048-7828066047e2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:58.590465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 568/1129] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:14:58 2022] GET /identity/v3/projects/ada60c4167d94cad895451fcea2b0b27 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:14:58.596686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:14:58.690624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0754f1c-03a0-4041-8655-8b73eb957cbf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:14:58.725110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:14:58.726753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:14:58.726909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:14:58.727186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:14:58.728019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] RBAC: Adding query filter params (role.id=ac8f159fb0e6486db134f18d9f5f1d94, scope.project.id=ada60c4167d94cad895451fcea2b0b27, user.id=2d58078661464d538b09544031e6876e) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:14:58.728335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:14:58.729764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b97eb0-234c-4dd7-9964-4d5853caf6a3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:14:58.735464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 562/1130] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:14:58 2022] GET /identity/v3/role_assignments?user.id=2d58078661464d538b09544031e6876e&scope.project.id=ada60c4167d94cad895451fcea2b0b27&role.id=ac8f159fb0e6486db134f18d9f5f1d94 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:00.979346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48602da7-9349-415c-b8bc-8986a3c55499 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:00.979899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48602da7-9349-415c-b8bc-8986a3c55499 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:00.979899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48602da7-9349-415c-b8bc-8986a3c55499 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:00.981264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 569/1131] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:00.988951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:00.988951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:00.988951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:01.006098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:01.008066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:01.073292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 563/1132] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:01.096454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48602da7-9349-415c-b8bc-8986a3c55499 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:01.200830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48602da7-9349-415c-b8bc-8986a3c55499 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:01.235274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e819f-2e47-4ef2-877d-ddea522a2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:01.235974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e819f-2e47-4ef2-877d-ddea522a2a0a None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:01.236256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e819f-2e47-4ef2-877d-ddea522a2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:01.236537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e819f-2e47-4ef2-877d-ddea522a2a0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:01.238008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e819f-2e47-4ef2-877d-ddea522a2a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:01.239431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e819f-2e47-4ef2-877d-ddea522a2a0a None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:01.241146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 570/1133] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:15:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:01.247706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:01.345152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ffc7c-82d0-4db2-9d5c-4cda1f1d1687 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:01.378290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff5f0-da33-4166-9587-f64efe8b4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:01.378949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff5f0-da33-4166-9587-f64efe8b4b05 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:01.379232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff5f0-da33-4166-9587-f64efe8b4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:01.379508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff5f0-da33-4166-9587-f64efe8b4b05 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:01.380219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ff5f0-da33-4166-9587-f64efe8b4b05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:01.382179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ff5f0-da33-4166-9587-f64efe8b4b05 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:01.407248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 564/1134] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:15:01 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:15:03.680679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca76a0-9d0c-48ba-bdac-470d7af60d72 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:03.681232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca76a0-9d0c-48ba-bdac-470d7af60d72 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:03.681232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca76a0-9d0c-48ba-bdac-470d7af60d72 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:03.682626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 571/1135] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:03.687778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:03.688204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:03.688346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:03.704787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:03.705990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:03.770073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 565/1136] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:03.796427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca76a0-9d0c-48ba-bdac-470d7af60d72 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:03.895056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca76a0-9d0c-48ba-bdac-470d7af60d72 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:03.928340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c64c11-a961-4a05-a2a9-94ddfcb017bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:03.929687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c64c11-a961-4a05-a2a9-94ddfcb017bd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:03.930003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c64c11-a961-4a05-a2a9-94ddfcb017bd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:03.930285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c64c11-a961-4a05-a2a9-94ddfcb017bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:03.931470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c64c11-a961-4a05-a2a9-94ddfcb017bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:03.932894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c64c11-a961-4a05-a2a9-94ddfcb017bd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:03.934535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 572/1137] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:03.940260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:04.032253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbcc2e-1523-4ff1-b9d1-44e94f682da5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:04.063871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b711c-6a3d-4670-8e1a-148617166d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:04.064522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b711c-6a3d-4670-8e1a-148617166d4d None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:04.064798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b711c-6a3d-4670-8e1a-148617166d4d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:04.065066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b711c-6a3d-4670-8e1a-148617166d4d None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:04.065751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b711c-6a3d-4670-8e1a-148617166d4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:04.067189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b711c-6a3d-4670-8e1a-148617166d4d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:04.086987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 566/1138] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:15:03 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:15:06.336107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598cb7-e9fb-4db7-be99-44d66ac1bfdb None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:06.336648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598cb7-e9fb-4db7-be99-44d66ac1bfdb None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:06.336648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598cb7-e9fb-4db7-be99-44d66ac1bfdb None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:06.338057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 573/1139] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:06.343220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:06.343624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:06.343773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:06.359861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:06.361017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:06.423044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 567/1140] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:06.446448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598cb7-e9fb-4db7-be99-44d66ac1bfdb None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:06.544432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598cb7-e9fb-4db7-be99-44d66ac1bfdb None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:06.576709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:06.577487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:06.577771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:06.578082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:06.588464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:15:06.596012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:06.597118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:15:06.598138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 574/1141] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:06.603519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:06.696372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc62001-dad8-4ff7-940b-376d7013b05c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:06.727464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:06.728122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:06.728403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:06.728679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:06.729426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:06.729730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:06.731118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:06.739131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 568/1142] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:06.745579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:06.842410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ccf32-4dca-4cb2-b298-4bc322896116 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:06.874271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:06.875128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:06.875409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:06.875685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] PATH_INFO: `/v3/users/8c87108f75c24264af0d00a61ebc7473` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:06.888674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] RBAC: Authorizing `identity:get_user(user_id=8c87108f75c24264af0d00a61ebc7473)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:06.890129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:06.891764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 575/1143] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:15:06 2022] GET /identity/v3/users/8c87108f75c24264af0d00a61ebc7473 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:06.897526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:06.992946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9d1c-e9ac-4c15-8da7-4ffdd0c0fe73 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:07.025064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:07.025702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:07.026020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:07.026295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:07.089146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:07.090623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:07.182559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 569/1144] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:15:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:15:07.188437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:07.284511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283997c2-503c-41fd-ac81-f513409eb762 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:07.318546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c2359-47f6-4bba-ac84-32e76346c40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:07.319504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c2359-47f6-4bba-ac84-32e76346c40d None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:07.320009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c2359-47f6-4bba-ac84-32e76346c40d None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:07.320297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c2359-47f6-4bba-ac84-32e76346c40d None admin] PATH_INFO: `/v3/projects/965ac44cf47e43fca88cbbd222a608b3` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:07.321469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c2359-47f6-4bba-ac84-32e76346c40d None admin] RBAC: Authorizing `identity:get_project(project_id=965ac44cf47e43fca88cbbd222a608b3)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:07.322925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c2359-47f6-4bba-ac84-32e76346c40d None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:07.324612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 576/1145] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:15:07 2022] GET /identity/v3/projects/965ac44cf47e43fca88cbbd222a608b3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:07.330749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:07.427099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499c16-b10a-4788-8207-ae47c9ce5a49 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:07.460724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:07.461333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:07.461613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:07.461912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:07.462850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=965ac44cf47e43fca88cbbd222a608b3, user.id=8c87108f75c24264af0d00a61ebc7473) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:07.463040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:07.464468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca999be-ec56-4d01-b751-44332250c74d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:07.470077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 570/1146] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:15:07 2022] GET /identity/v3/role_assignments?user.id=8c87108f75c24264af0d00a61ebc7473&scope.project.id=965ac44cf47e43fca88cbbd222a608b3&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:09.693652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1618871-fd9c-4a11-90a9-8099cb436da8 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:09.694272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1618871-fd9c-4a11-90a9-8099cb436da8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:09.694378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1618871-fd9c-4a11-90a9-8099cb436da8 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:09.695709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 577/1147] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:09.700969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:09.701403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:09.701536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:09.719041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:09.720135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:09.785216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 571/1148] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:09.809504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1618871-fd9c-4a11-90a9-8099cb436da8 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:09.908328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1618871-fd9c-4a11-90a9-8099cb436da8 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:09.941259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:09.942059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:09.942340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:09.942611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:09.953920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:15:09.962157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:09.963226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:15:09.964193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 578/1149] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:15:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:09.969462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:10.064242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429137ab-5795-4ed3-8c4b-c135b68e5e3f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:10.096918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:10.097585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:10.097895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:10.098176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:10.098918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:10.099227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:10.100798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:10.108763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 572/1150] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:15:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:10.115072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:10.207671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24b92-f70c-406e-a2ad-dffd02690d56 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:10.239731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:10.240517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:10.240802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:10.241141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] PATH_INFO: `/v3/users/8c87108f75c24264af0d00a61ebc7473` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:10.242355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] RBAC: Authorizing `identity:get_user(user_id=8c87108f75c24264af0d00a61ebc7473)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:10.243783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:10.245395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 579/1151] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:15:10 2022] GET /identity/v3/users/8c87108f75c24264af0d00a61ebc7473 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:10.251173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:10.346962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1009-63a6-466c-9176-9aa62d3f3ff6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:10.378762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06def-c179-4991-ada6-8635ddd01965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:10.379609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06def-c179-4991-ada6-8635ddd01965 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:10.379884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06def-c179-4991-ada6-8635ddd01965 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:10.380152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06def-c179-4991-ada6-8635ddd01965 None admin] PATH_INFO: `/v3/projects/965ac44cf47e43fca88cbbd222a608b3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:10.381316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06def-c179-4991-ada6-8635ddd01965 None admin] RBAC: Authorizing `identity:get_project(project_id=965ac44cf47e43fca88cbbd222a608b3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:10.383354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06def-c179-4991-ada6-8635ddd01965 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:10.385037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 573/1152] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:15:10 2022] GET /identity/v3/projects/965ac44cf47e43fca88cbbd222a608b3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:10.391088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:10.486940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216ad28-e1a4-458e-9c57-470a5ec51f71 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:10.519160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e642fb3-a81a-4bd4-977d-980d79baf06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:10.519980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e642fb3-a81a-4bd4-977d-980d79baf06c None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:10.520266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e642fb3-a81a-4bd4-977d-980d79baf06c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:10.520539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e642fb3-a81a-4bd4-977d-980d79baf06c None admin] PATH_INFO: `/v3/projects/965ac44cf47e43fca88cbbd222a608b3/users/8c87108f75c24264af0d00a61ebc7473/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:10.522519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e642fb3-a81a-4bd4-977d-980d79baf06c None admin] RBAC: Authorizing `identity:create_grant(project_id=965ac44cf47e43fca88cbbd222a608b3, user_id=8c87108f75c24264af0d00a61ebc7473, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:10.523931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e642fb3-a81a-4bd4-977d-980d79baf06c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:10.536788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 580/1153] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:15:10 2022] PUT /identity/v3/projects/965ac44cf47e43fca88cbbd222a608b3/users/8c87108f75c24264af0d00a61ebc7473/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:15:12.755215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748de2-ed56-4276-a7b1-f7ad448df5f3 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:12.755746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748de2-ed56-4276-a7b1-f7ad448df5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:12.755746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748de2-ed56-4276-a7b1-f7ad448df5f3 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:12.757096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 574/1154] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:12.762527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:12.762966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:12.763115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:12.780314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:12.781504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:12.848510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 581/1155] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:12.872290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748de2-ed56-4276-a7b1-f7ad448df5f3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:12.968788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748de2-ed56-4276-a7b1-f7ad448df5f3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:13.001954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:13.002731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:13.003009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:13.003282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:13.013155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:15:13.020638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:13.021746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:15:13.023867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 575/1156] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:13.028444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:13.122949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be37ed-985f-4cc2-9846-ba8717b0f07f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:13.156066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:13.156735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:13.157021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:13.157299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:13.158077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:13.158391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:13.159760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:13.168194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 582/1157] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:13.174105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:13.268532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079fb11-4b83-4729-a683-6a9e33e2c83f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:13.299383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:13.300226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:13.300506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:13.300778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] PATH_INFO: `/v3/users/8c87108f75c24264af0d00a61ebc7473` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:13.301956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] RBAC: Authorizing `identity:get_user(user_id=8c87108f75c24264af0d00a61ebc7473)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:13.303429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:13.305129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 576/1158] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:15:13 2022] GET /identity/v3/users/8c87108f75c24264af0d00a61ebc7473 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:13.311052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:13.406074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3086b-74a9-4e37-a768-f19dd9574747 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:13.437754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:13.438422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:13.438704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:13.438988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:13.502517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:13.503949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:13.595745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 583/1159] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:15:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:15:13.602224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:13.699695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba4495-f793-4b5e-9f25-205f8abe8d7a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:13.732024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021b897-41c1-49fb-a406-d53d11f86149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:13.732866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021b897-41c1-49fb-a406-d53d11f86149 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:13.733147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021b897-41c1-49fb-a406-d53d11f86149 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:13.733420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021b897-41c1-49fb-a406-d53d11f86149 None admin] PATH_INFO: `/v3/projects/965ac44cf47e43fca88cbbd222a608b3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:13.734607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021b897-41c1-49fb-a406-d53d11f86149 None admin] RBAC: Authorizing `identity:get_project(project_id=965ac44cf47e43fca88cbbd222a608b3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:13.736020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021b897-41c1-49fb-a406-d53d11f86149 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:13.738048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 577/1160] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:15:13 2022] GET /identity/v3/projects/965ac44cf47e43fca88cbbd222a608b3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:13.744740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:13.840393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623845ae-66b5-4496-bb0e-16f94ca26960 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:13.873054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:13.873729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:13.873949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:13.874225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:13.875056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=965ac44cf47e43fca88cbbd222a608b3, user.id=8c87108f75c24264af0d00a61ebc7473) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:13.875367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:13.876781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6718-2438-4818-863a-de57ec70e676 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:13.883156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 584/1161] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:15:13 2022] GET /identity/v3/role_assignments?user.id=8c87108f75c24264af0d00a61ebc7473&scope.project.id=965ac44cf47e43fca88cbbd222a608b3&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:16.119698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba75b-4f7b-40fd-ab03-1674451530a6 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:16.120273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba75b-4f7b-40fd-ab03-1674451530a6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:16.120273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba75b-4f7b-40fd-ab03-1674451530a6 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:16.121612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 578/1162] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:16.126969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:16.127345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:16.127529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:16.143930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:16.145107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:16.208380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 585/1163] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:16.231391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ba75b-4f7b-40fd-ab03-1674451530a6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:16.329355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ba75b-4f7b-40fd-ab03-1674451530a6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:16.361248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:16.362159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:16.362437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:16.362709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:16.425165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:16.426579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:16.519958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 579/1164] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:15:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:15:16.526639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:16.621612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f302-1220-4f56-a44c-a3972ae073e9 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:16.657332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:16.658146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:16.658427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:16.658807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:16.666471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:16.667917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-c762b406-a83a-4947-b8f0-61ebee8941ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:16.681910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:16.683115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:15:16.683956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 586/1165] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:15:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:16.689020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:16.783758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6ddb8-c03c-4424-bcf5-9923b42a372c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:16.816616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:16.817276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:16.817559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:16.817860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:16.818583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:16.819511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:16.821102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc6d7f-7dce-4916-985a-0b691db4df67 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:16.828138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 580/1166] 10.222.0.84 () {56 vars in 1115 bytes} [Fri May 13 18:15:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:19.083989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752cb0b-a924-46d4-9751-bc11cae92a54 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:19.085160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752cb0b-a924-46d4-9751-bc11cae92a54 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:19.085160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752cb0b-a924-46d4-9751-bc11cae92a54 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:19.086608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 587/1167] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:19.091893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a10a9-7e20-4013-b326-e921cda5bcf2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:19.092296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a10a9-7e20-4013-b326-e921cda5bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:19.092444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a10a9-7e20-4013-b326-e921cda5bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:19.108733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ea8a10a9-7e20-4013-b326-e921cda5bcf2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:19.109942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ea8a10a9-7e20-4013-b326-e921cda5bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:19.172624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 581/1168] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:19.196032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752cb0b-a924-46d4-9751-bc11cae92a54 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:19.292161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752cb0b-a924-46d4-9751-bc11cae92a54 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:19.323804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504a9a8-0069-4564-9e3f-8fbd4b80ab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:19.324448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a9a8-0069-4564-9e3f-8fbd4b80ab3b None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:19.324730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a9a8-0069-4564-9e3f-8fbd4b80ab3b None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:19.325007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a9a8-0069-4564-9e3f-8fbd4b80ab3b None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:19.325746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504a9a8-0069-4564-9e3f-8fbd4b80ab3b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:19.327126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504a9a8-0069-4564-9e3f-8fbd4b80ab3b None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:19.341265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 588/1169] 10.222.0.84 () {60 vars in 1138 bytes} [Fri May 13 18:15:19 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:15:21.599449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13232421-af02-47eb-b647-256938908f4b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:21.600044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13232421-af02-47eb-b647-256938908f4b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:21.600476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13232421-af02-47eb-b647-256938908f4b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:21.601969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 582/1170] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:21.607361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:21.607836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:21.607930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:21.624284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:21.625453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:21.689934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 589/1171] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:21.714841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13232421-af02-47eb-b647-256938908f4b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:21.815343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13232421-af02-47eb-b647-256938908f4b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:21.848930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad36da-5af1-42a8-a031-770115361fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:21.850264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad36da-5af1-42a8-a031-770115361fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:21.850560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad36da-5af1-42a8-a031-770115361fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:21.850839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad36da-5af1-42a8-a031-770115361fb9 None admin] PATH_INFO: `/v3/domains/a171d87d1a13477ab64712c299cddedd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:21.860730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad36da-5af1-42a8-a031-770115361fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a171d87d1a13477ab64712c299cddedd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:21.862473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad36da-5af1-42a8-a031-770115361fb9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:21.864106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 583/1172] 10.222.0.84 () {56 vars in 1183 bytes} [Fri May 13 18:15:21 2022] GET /identity/v3/domains/a171d87d1a13477ab64712c299cddedd => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:21.870603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:21.964275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850f95c-1a11-4f5c-bbd9-2f164f2140c9 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:21.996753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941e106-7be0-4934-8456-980046ce3fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:21.997343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e106-7be0-4934-8456-980046ce3fa9 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:21.997629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e106-7be0-4934-8456-980046ce3fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:21.997935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e106-7be0-4934-8456-980046ce3fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:21.998642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e106-7be0-4934-8456-980046ce3fa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:22.000056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e106-7be0-4934-8456-980046ce3fa9 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:22.025202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 590/1173] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:15:21 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:15:24.297289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03531ee4-2b5d-4c02-89c2-5ba7a0410faf None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:24.297901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03531ee4-2b5d-4c02-89c2-5ba7a0410faf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:24.297901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03531ee4-2b5d-4c02-89c2-5ba7a0410faf None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:24.299237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 584/1174] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:24.305327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:24.305754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:24.305892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:24.322089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:24.323250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:24.386879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 591/1175] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:24.411925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03531ee4-2b5d-4c02-89c2-5ba7a0410faf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:24.512823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03531ee4-2b5d-4c02-89c2-5ba7a0410faf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:24.544322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5df0-8bd8-4a3e-89cb-bf85d5ddce59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:24.545175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5df0-8bd8-4a3e-89cb-bf85d5ddce59 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:24.545451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5df0-8bd8-4a3e-89cb-bf85d5ddce59 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:24.545719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5df0-8bd8-4a3e-89cb-bf85d5ddce59 None admin] PATH_INFO: `/v3/domains/a171d87d1a13477ab64712c299cddedd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:24.546911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f5df0-8bd8-4a3e-89cb-bf85d5ddce59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a171d87d1a13477ab64712c299cddedd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:24.548380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f5df0-8bd8-4a3e-89cb-bf85d5ddce59 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:24.549945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 585/1176] 10.222.0.84 () {56 vars in 1183 bytes} [Fri May 13 18:15:24 2022] GET /identity/v3/domains/a171d87d1a13477ab64712c299cddedd => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:24.557063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:24.654433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63951dc-0fc1-44d2-b709-03456894cf3b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:24.691682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a1ef-a364-44af-a81c-28214cd9f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:24.692360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a1ef-a364-44af-a81c-28214cd9f7a4 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:24.692643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a1ef-a364-44af-a81c-28214cd9f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:24.692918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a1ef-a364-44af-a81c-28214cd9f7a4 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:24.693859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134a1ef-a364-44af-a81c-28214cd9f7a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:24.695318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134a1ef-a364-44af-a81c-28214cd9f7a4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:24.720552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 592/1177] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:15:24 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:15:27.060839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e4ec3-82b3-4876-a04f-1935bd7fe994 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:27.061411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e4ec3-82b3-4876-a04f-1935bd7fe994 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:27.061411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e4ec3-82b3-4876-a04f-1935bd7fe994 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:27.062754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 586/1178] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:27.067924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:27.068911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:27.069299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:27.085462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:27.086669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:27.150673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 593/1179] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:27.173533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e4ec3-82b3-4876-a04f-1935bd7fe994 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:27.273079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e4ec3-82b3-4876-a04f-1935bd7fe994 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:27.306868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:27.307646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:27.307930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:27.308207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:27.317899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:15:27.326091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:27.327218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:15:27.328172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 587/1180] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:27.333299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:27.424318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1681330-e939-4d2c-875f-2c20b9c16e03 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:27.455994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:27.456753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:27.457041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:27.457311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:27.458235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:27.458537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:27.460571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:27.469139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 594/1181] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:27.474901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:27.570149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe62a9-f34f-43a7-ba10-7752c58a7595 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:27.601982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:27.603304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:27.603620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:27.603900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] PATH_INFO: `/v3/users/e2de6db7839b446a8da42a7052fa01db` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:27.620628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] RBAC: Authorizing `identity:get_user(user_id=e2de6db7839b446a8da42a7052fa01db)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:27.622340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:27.624070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 588/1182] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:15:27 2022] GET /identity/v3/users/e2de6db7839b446a8da42a7052fa01db => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:27.629914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:27.724973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5f3e7-50f5-4ae3-a81a-55c03a8ebcdf None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:27.757196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:27.757852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:27.758158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:27.758418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:27.822079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:27.823430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:27.917118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 595/1183] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:15:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:15:27.923038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:28.019816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812aec-6284-4533-866d-645108f0b0ef None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:28.051859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a00cbc-b4f4-4d24-9ca4-a5994d04829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:28.053261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a00cbc-b4f4-4d24-9ca4-a5994d04829b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:28.053567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a00cbc-b4f4-4d24-9ca4-a5994d04829b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:28.053841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a00cbc-b4f4-4d24-9ca4-a5994d04829b None admin] PATH_INFO: `/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:28.055018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a00cbc-b4f4-4d24-9ca4-a5994d04829b None admin] RBAC: Authorizing `identity:get_project(project_id=1299b3e1df6346bc8d619ea7f3c8cbda)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:28.056448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a00cbc-b4f4-4d24-9ca4-a5994d04829b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:28.058252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 589/1184] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:15:27 2022] GET /identity/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:28.064285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:28.163548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c128-2f50-4548-912f-c70a64a27811 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:28.195246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:28.195894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:28.196171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:28.196445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:28.197273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=1299b3e1df6346bc8d619ea7f3c8cbda, user.id=e2de6db7839b446a8da42a7052fa01db) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:28.197584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:28.199028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5db0c-2dae-4a04-b6b7-78eb78e904ec None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:28.204211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 596/1185] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:15:28 2022] GET /identity/v3/role_assignments?user.id=e2de6db7839b446a8da42a7052fa01db&scope.project.id=1299b3e1df6346bc8d619ea7f3c8cbda&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:30.481979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd043f99-541b-47b6-aae2-5885335a9142 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:30.482460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd043f99-541b-47b6-aae2-5885335a9142 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:30.482572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd043f99-541b-47b6-aae2-5885335a9142 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:30.483876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 590/1186] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:30.489299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:30.489700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:30.489878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:30.507048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:30.508206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:30.571964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 597/1187] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:30.594754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd043f99-541b-47b6-aae2-5885335a9142 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:30.691892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd043f99-541b-47b6-aae2-5885335a9142 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:30.725167 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:30.725890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:30.726175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:30.726450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:30.736041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:15:30.744523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:30.745662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:15:30.747017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 591/1188] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:30.751776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:30.844628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985395b-9f50-4df1-a3d0-cae522355cb3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:30.876622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:30.877278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:30.877558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:30.877851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:30.878590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:30.878893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:30.880254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:30.888405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 598/1189] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:15:30.894318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:30.992489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219546c-c4e0-4cf6-9308-f23b33fb7cb3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:31.024180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:31.025042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:31.025320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:31.025591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] PATH_INFO: `/v3/users/e2de6db7839b446a8da42a7052fa01db` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:31.026774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e2de6db7839b446a8da42a7052fa01db)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:31.028184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:31.029785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 592/1190] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:15:30 2022] GET /identity/v3/users/e2de6db7839b446a8da42a7052fa01db => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:31.035612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:31.131123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0d6e5-1943-413b-89b6-857fc007ce04 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:31.162836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961df37-7ce6-4cea-afcc-a51fe2c0efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:31.163685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961df37-7ce6-4cea-afcc-a51fe2c0efc7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:31.163965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961df37-7ce6-4cea-afcc-a51fe2c0efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:31.164240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961df37-7ce6-4cea-afcc-a51fe2c0efc7 None admin] PATH_INFO: `/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:31.165398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961df37-7ce6-4cea-afcc-a51fe2c0efc7 None admin] RBAC: Authorizing `identity:get_project(project_id=1299b3e1df6346bc8d619ea7f3c8cbda)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:31.166871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961df37-7ce6-4cea-afcc-a51fe2c0efc7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:31.168859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 599/1191] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:15:31 2022] GET /identity/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:31.174885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:31.269687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baac225-1661-4170-8377-7b59197399e8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:31.301436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205baa05-3219-4d19-8756-f4bb3b60b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:31.303045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205baa05-3219-4d19-8756-f4bb3b60b37a None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:31.303369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205baa05-3219-4d19-8756-f4bb3b60b37a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:31.303605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205baa05-3219-4d19-8756-f4bb3b60b37a None admin] PATH_INFO: `/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda/users/e2de6db7839b446a8da42a7052fa01db/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:31.305561 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205baa05-3219-4d19-8756-f4bb3b60b37a None admin] RBAC: Authorizing `identity:create_grant(project_id=1299b3e1df6346bc8d619ea7f3c8cbda, user_id=e2de6db7839b446a8da42a7052fa01db, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:31.307018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205baa05-3219-4d19-8756-f4bb3b60b37a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:31.319241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 593/1192] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:15:31 2022] PUT /identity/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda/users/e2de6db7839b446a8da42a7052fa01db/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:15:33.578353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c431042-5f42-4777-b5dd-1bf54ebc4c22 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:33.578881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c431042-5f42-4777-b5dd-1bf54ebc4c22 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:33.578998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c431042-5f42-4777-b5dd-1bf54ebc4c22 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:33.580275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 600/1193] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:15:33.586250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:33.586674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:33.586808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:33.603817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:15:33.604993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:15:33.669598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 594/1194] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:15:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:15:33.694610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c431042-5f42-4777-b5dd-1bf54ebc4c22 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:33.790967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c431042-5f42-4777-b5dd-1bf54ebc4c22 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:33.823859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:33.824644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:33.824923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:33.825218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:33.835106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:15:33.842712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:15:33.844405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:15:33.845585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 601/1195] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:15:33.850375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:33.946373 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c349f7-3fa4-44a2-8e0d-89b83cb2dcb1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:33.980894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:33.981555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:33.981864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:33.982146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:33.982890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:33.983198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:33.984560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:33.993491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 595/1196] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:33.999247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:34.091241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954b250-d9d8-4efc-9582-dba5531be180 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:34.123211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:34.124067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:34.124340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:34.124609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] PATH_INFO: `/v3/users/e2de6db7839b446a8da42a7052fa01db` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:34.125768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2de6db7839b446a8da42a7052fa01db)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:34.127206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:34.128810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 602/1197] 10.222.0.84 () {56 vars in 1177 bytes} [Fri May 13 18:15:33 2022] GET /identity/v3/users/e2de6db7839b446a8da42a7052fa01db => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:15:34.134746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:34.229761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6050c9-43e1-425b-bbd6-3773ca30aa49 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:34.262320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:34.262953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:34.263234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:34.263508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:34.326092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:34.327529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:34.420266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 596/1198] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:15:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 18:15:34.426152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:34.522951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2e94f-691a-492f-bb5c-a9e3cc0381c3 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:34.554167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02a1f7-ef39-4651-a876-cd16df0ee3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:34.555001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02a1f7-ef39-4651-a876-cd16df0ee3d5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:34.555282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02a1f7-ef39-4651-a876-cd16df0ee3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:34.555556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02a1f7-ef39-4651-a876-cd16df0ee3d5 None admin] PATH_INFO: `/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:34.556713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02a1f7-ef39-4651-a876-cd16df0ee3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=1299b3e1df6346bc8d619ea7f3c8cbda)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:34.558164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02a1f7-ef39-4651-a876-cd16df0ee3d5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:34.559836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 603/1199] 10.222.0.84 () {56 vars in 1186 bytes} [Fri May 13 18:15:34 2022] GET /identity/v3/projects/1299b3e1df6346bc8d619ea7f3c8cbda => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:15:34.565860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:15:34.658839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5aa20-a4ce-4c83-b157-c489e37f864a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:15:34.691274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:15:34.691859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:15:34.692136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:15:34.692405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:15:34.693266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=1299b3e1df6346bc8d619ea7f3c8cbda, user.id=e2de6db7839b446a8da42a7052fa01db) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:15:34.693570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:15:34.695018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90c4a3-b033-491b-aef2-54e057167196 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:15:34.700644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 597/1200] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:15:34 2022] GET /identity/v3/role_assignments?user.id=e2de6db7839b446a8da42a7052fa01db&scope.project.id=1299b3e1df6346bc8d619ea7f3c8cbda&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:36.236346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298ce99-f764-41e7-9c5e-c841df2809f5 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:36.236996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298ce99-f764-41e7-9c5e-c841df2809f5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:36.236996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298ce99-f764-41e7-9c5e-c841df2809f5 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:36.239416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 604/1201] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:16:36.246191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:36.246760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:36.246760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:36.268018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:16:36.269635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:16:36.350958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 598/1202] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:16:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:16:36.383183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298ce99-f764-41e7-9c5e-c841df2809f5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:36.518432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298ce99-f764-41e7-9c5e-c841df2809f5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:36.562470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:36.563276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:36.563579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:36.563853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:36.575489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:36.576977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:36.596723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:36.602195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:36.603250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:36.603250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:36.603250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:36.603250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:36.603250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 605/1203] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:36.604785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:36.732757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d710e86-3ca6-4097-a8ce-8bb74ee3a939 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:36.789875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:36.790771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:36.791058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:36.791450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:36.792584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:36.792930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:36.794782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a783-df5d-41ab-9eae-bca5d51ccb31 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:36.815725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 599/1204] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:36.817290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:36.932467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd57a-dc7a-455d-9989-c616ffd7d826 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:36.976312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90b6c-16a5-45b7-a533-13c70f1a681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:36.977033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90b6c-16a5-45b7-a533-13c70f1a681c None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:36.977294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90b6c-16a5-45b7-a533-13c70f1a681c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:36.977557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90b6c-16a5-45b7-a533-13c70f1a681c None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:36.978301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90b6c-16a5-45b7-a533-13c70f1a681c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:36.979744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90b6c-16a5-45b7-a533-13c70f1a681c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:37.007216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 606/1205] 10.222.0.84 () {60 vars in 1132 bytes} [Fri May 13 18:16:36 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:16:39.555925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87fdf-cfe8-49ac-9f45-2601a4bf7be4 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:39.556466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87fdf-cfe8-49ac-9f45-2601a4bf7be4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:39.556466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87fdf-cfe8-49ac-9f45-2601a4bf7be4 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:39.557874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 600/1206] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:16:39.563320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:39.563768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:39.563869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:39.581848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:16:39.583232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:16:39.661369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 607/1207] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:16:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:16:39.686927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87fdf-cfe8-49ac-9f45-2601a4bf7be4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:39.801146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87fdf-cfe8-49ac-9f45-2601a4bf7be4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:39.839694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:39.840496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:39.840779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:39.841058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:39.852881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:16:39.861162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:39.862932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:39.864461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 601/1208] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:39.870320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:40.007710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487314b8-9bcc-444c-a3c8-79d525f5178f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:40.049385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:40.050674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:40.050995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:40.051403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:40.052078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:40.052389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:40.053758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:40.062933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 608/1209] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:40.068435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:40.177918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2b39-f640-46c1-8105-27454957a06a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:40.214089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:40.215467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:40.216027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:40.216507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:40.230801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:40.232466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:40.256611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:40.257638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:40.258646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:40.258646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:40.258646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:40.258646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:40.260748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 602/1210] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:40.266498 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:40.380021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee175-9a3e-40b3-84b1-6f11ee4a9317 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:40.427988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:40.428853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:40.429175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:40.429579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:40.430517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:40.431096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:40.432758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:40.448421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 609/1211] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:40.454156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:40.570761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde3a7-768c-4187-bc99-262c8e920b3f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:40.606501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:40.607533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:40.607983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:40.608398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:40.619636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:40.621465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:16:40.639204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:40.640248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:40.641353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 603/1212] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:16:40.646770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:40.765710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd261f9-0320-4d4a-b977-9978f13035d6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:40.807195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:40.807878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:40.808157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:40.808424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:40.809426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:40.809783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:40.811435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:40.841505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 610/1213] 10.222.0.84 () {56 vars in 1143 bytes} [Fri May 13 18:16:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:40.842811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:40.957034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545090a-08ff-4aa7-b7bf-03815d15e366 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:40.999266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:41.000081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:41.000466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:41.000842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:41.075276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:41.080274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:41.182525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 604/1214] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:16:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:16:41.188567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:41.297017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44d3b-5975-4ddc-bd3a-db6635117df2 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:41.336030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:41.337056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:41.337475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:41.337748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:41.351139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:41.352846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:41.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:41.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:41.374343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:41.374343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:41.374343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:41.374343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:41.376266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 611/1215] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:41.381829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:41.488972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d64519-fabc-40ad-bedf-8443d037a29a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:41.529741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:41.530557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:41.530916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:41.531268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:41.532057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:41.532492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:41.534690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:41.552371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 605/1216] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:41.553159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:41.657070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89466a0f-ebac-4406-8d5a-7fa749c446d1 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:41.695964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:41.696755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:41.697041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:41.697317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:41.705271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:41.707608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:16:41.723265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:41.725371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:41.726351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 612/1217] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:41.731060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:41.844869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3d724-ad2d-4ff4-8dfd-578e17100a23 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:41.884380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:41.885087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:41.885370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:41.885677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:41.887272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:41.887614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:41.889054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6dd9-a35b-4832-a910-958ffbb3280d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:41.903278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 606/1218] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:41.911181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:42.032993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05e77-43e8-436f-95b7-efecca645244 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:42.070653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:42.071338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:42.071618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:42.071886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:42.072720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=bf69e911e669406982a5943d7841993e) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:42.073027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:42.074490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf110f-0fb9-41de-9d0c-d735a6a833f7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:42.083482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 613/1219] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:16:41 2022] GET /identity/v3/role_assignments?user.id=bf69e911e669406982a5943d7841993e&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:16:44.368438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b7768-8df0-4625-99a4-f2a84886e601 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:44.369018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b7768-8df0-4625-99a4-f2a84886e601 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:44.369018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b7768-8df0-4625-99a4-f2a84886e601 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:44.370542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 607/1220] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:16:44.375803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:44.376416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:44.376416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:44.394596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:16:44.395779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:16:44.467923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 614/1221] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:16:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:16:44.492765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b7768-8df0-4625-99a4-f2a84886e601 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:44.600089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b7768-8df0-4625-99a4-f2a84886e601 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:44.636024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:44.636757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:44.637030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:44.637355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:44.648988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:16:44.657184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:44.658323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:16:44.659946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:44.664081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 608/1222] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:44.665456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:44.788148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b9b70-0053-43a4-9f6d-83e6678560c6 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:44.832157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:44.833319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:44.833883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:44.834396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:44.835853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:44.836428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:44.839114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:44.848418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 615/1223] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:16:44.854267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:44.959033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa1ebe-c1d1-49c5-9fe6-993e6db36fd6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:44.999310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:45.000405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:45.000976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:45.001255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:45.016869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:45.018389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:45.035878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:45.037012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:45.037975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:45.037975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:45.037975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:45.037975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:45.041827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 609/1224] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:45.042883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:45.146742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ace5b-d524-4753-bd27-b4e2209801b4 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:45.180907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:45.181577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:45.181890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:45.182169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:45.182891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:45.183202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:45.184574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:45.197895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 616/1225] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:45.203710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:45.312737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c439a-b0d3-4e22-b406-9220c3197f98 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:45.348119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:45.349042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:45.349339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:45.349611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:45.357907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:45.359598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:16:45.376106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:45.378251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:45.379511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 610/1226] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:45.383868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:45.495643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec98cd-49bf-4fe8-b63b-3dbd66631693 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:45.542898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:45.543856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:45.544275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:45.544644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:45.545882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:45.546298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:45.548434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:45.579340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 617/1227] 10.222.0.84 () {56 vars in 1143 bytes} [Fri May 13 18:16:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:45.585920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:45.697631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97176c-9602-45c1-9574-5dde7aaecd42 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:45.739019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:45.739962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:45.740246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:45.740524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:45.755035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:45.756603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:45.777938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:45.779536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:45.780842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:45.780842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:45.780842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:45.780842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:45.780842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 611/1228] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:45.786545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:45.892581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a38c7-7499-4a5d-92c4-b7bb2c630582 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:45.931603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:45.932306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:45.932580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:45.932854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:45.933574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:45.933911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:45.935280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:45.948706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 618/1229] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:45.954391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:46.077721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac371d9e-c098-4e19-a6c7-9a1ae775feae None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:46.114357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:46.115156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:46.115437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:46.115709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:46.122448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:46.123894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:16:46.139782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:46.140951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:46.142119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:46.146053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 612/1230] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:46.147585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:46.256637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eecba-284c-4bf2-87f5-4ee06e6ce9f5 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:46.298749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:46.299854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:46.300202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:46.300546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:46.301705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:46.302257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:46.304258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e9c7d-da11-4b64-a35c-d0ba7c240bc5 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:46.324424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 619/1231] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:46.325694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:46.440965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfe7e6-116f-48df-b5f0-c21023b4074c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:46.482453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d1d73-bcde-4f26-a2ba-7cf7f87b0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:46.483344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d1d73-bcde-4f26-a2ba-7cf7f87b0840 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:46.483628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d1d73-bcde-4f26-a2ba-7cf7f87b0840 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:46.483979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d1d73-bcde-4f26-a2ba-7cf7f87b0840 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/bf69e911e669406982a5943d7841993e/roles/a2b903646fa94c0ba521f8f3ddc2b04b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:46.502043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d1d73-bcde-4f26-a2ba-7cf7f87b0840 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=bf69e911e669406982a5943d7841993e, role_id=a2b903646fa94c0ba521f8f3ddc2b04b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:46.504698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d1d73-bcde-4f26-a2ba-7cf7f87b0840 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:46.518178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 613/1232] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:16:46 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/bf69e911e669406982a5943d7841993e/roles/a2b903646fa94c0ba521f8f3ddc2b04b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:16:48.941141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fb00-8c2a-41ca-86e4-79bc1d36d9f4 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:48.942048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fb00-8c2a-41ca-86e4-79bc1d36d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:48.942048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fb00-8c2a-41ca-86e4-79bc1d36d9f4 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:48.943284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 620/1233] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:16:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:16:48.948768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:48.949203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:48.949327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:48.970295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:16:48.972239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:16:49.055790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 614/1234] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:16:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:16:49.081969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fb00-8c2a-41ca-86e4-79bc1d36d9f4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:49.208739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fb00-8c2a-41ca-86e4-79bc1d36d9f4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:49.246868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:49.247654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:49.247936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:49.248214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:49.258941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:16:49.266825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:49.268169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:49.269047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 621/1235] 10.222.0.84 () {56 vars in 1102 bytes} [Fri May 13 18:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:49.274391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:49.378485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93f6fb-8eb1-4ffc-a62d-2ed9f6951a93 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:49.418639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:49.419279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:49.419563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:49.419839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:49.420583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:49.420890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:49.422303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:49.430865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 615/1236] 10.222.0.84 () {56 vars in 1103 bytes} [Fri May 13 18:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:16:49.438403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:49.547207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7a576-bef4-4d59-bdaf-7a94292bbcbb None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:49.584764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:49.585737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:49.586055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:49.586333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:49.598888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:49.600560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:49.622107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:49.623291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:49.624681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:49.624681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:49.624681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:49.624681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:49.624681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 622/1237] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:49.630618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:49.747469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033b8bf-c55e-4013-9fe6-a304dbcf6eec None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:49.785605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:49.786312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:49.786597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:49.786886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:49.787620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:49.787904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:49.789298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:49.802782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 616/1238] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:49.808556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:49.915117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763016f6-3f6c-418d-8de3-bd540e90c4e7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:49.951501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:49.952301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:49.952580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:49.952876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:49.961085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:49.962774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:16:49.977066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:49.978433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:49.979406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 623/1239] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:49.984323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:50.091765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819afff-52c7-457c-b646-a17710b613ef None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:50.129330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:50.130044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:50.130417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:50.130596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:50.131465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:50.131751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:50.133171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:50.157629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 617/1240] 10.222.0.84 () {56 vars in 1143 bytes} [Fri May 13 18:16:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:16:50.164096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:50.279722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bbc9f-28b8-49bb-844d-17821b6293b8 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:50.317188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:50.317873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:50.318160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:50.318447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:50.396780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:50.399476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:50.507576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 624/1241] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:16:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:16:50.513507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:50.625424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7b02-c20f-45d3-ba8e-170b9fe18d65 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:50.660057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:50.660770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:50.661054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:50.661331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:50.671214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:50.672677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:50.691754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:50.692912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:50.694087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:50.694087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:50.694087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:50.694087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:50.694087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 618/1242] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:50.700558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:50.806038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9889208-00d6-4e11-93b6-1b61d8fffb07 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:50.841375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:50.842017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:50.842310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:50.842576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:50.843300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:50.843605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:50.844968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:50.856866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 625/1243] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:50.863487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:50.970765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b27d1-238b-4b4d-8578-60f95c2eac57 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:51.009120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:51.009969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:51.010258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:51.010586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:51.018718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:51.020179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:16:51.034877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:51.036154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:51.037107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 619/1244] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:51.042212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:51.145045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223261-ff7c-4d22-b2ca-abacc003d795 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:51.181669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:51.182424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:51.182725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:51.183035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:51.183860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:51.184209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:51.185728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d070a-2ad2-498d-9396-e607c53d74d3 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:51.198746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 626/1245] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:51.204975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:51.312242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68a13-d7f6-49aa-a9ac-5d37978a0888 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:51.349275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:51.349982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:51.350325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:51.350603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:51.351472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] RBAC: Adding query filter params (role.id=a2b903646fa94c0ba521f8f3ddc2b04b, scope.project.id=31dac20388d84281bab425701bac98be, user.id=bf69e911e669406982a5943d7841993e) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:51.351787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:51.353413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f4ee-8467-41bc-8c02-86ff0cc24de0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:51.360946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 620/1246] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:16:51 2022] GET /identity/v3/role_assignments?user.id=bf69e911e669406982a5943d7841993e&scope.project.id=31dac20388d84281bab425701bac98be&role.id=a2b903646fa94c0ba521f8f3ddc2b04b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:53.951415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08e9f2-db01-46a2-9a80-402ba9065e2d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:53.952006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08e9f2-db01-46a2-9a80-402ba9065e2d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:53.952006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08e9f2-db01-46a2-9a80-402ba9065e2d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:53.953545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 627/1247] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:16:53.961290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:53.961808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:53.962146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:53.982646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:16:53.984256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:16:54.066205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 621/1248] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:16:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:16:54.090628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08e9f2-db01-46a2-9a80-402ba9065e2d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:54.201769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08e9f2-db01-46a2-9a80-402ba9065e2d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:54.239824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:54.240721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:54.240901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:54.241195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:54.251664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:16:54.259872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:54.261089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:54.262951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 628/1249] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:54.268274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:54.374670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8b8c-e4b4-414a-9d6f-f517b8eebc08 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:54.410088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:54.410765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:54.411052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:54.411329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:54.412076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:54.412384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:54.413746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:54.422350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 622/1250] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:54.429282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:54.539123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324d52-858b-40eb-ac33-1135b90ce964 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:54.578395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:54.579315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:54.579824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:54.581350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:54.594252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:54.595724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:54.618138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:54.619334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:54.620459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:54.620459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:54.620459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:54.620459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:54.620459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 629/1251] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:54.625308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:54.734104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f30ef2-a7e4-451d-b157-5eea668129a6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:54.770870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:54.771551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:54.771821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:54.772073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:54.772788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:54.773082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:54.774566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:54.789898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 623/1252] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:54.794271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:54.904762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c39b6-c0a2-44e3-bd5d-ef9349275569 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:54.940011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:54.941092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:54.941380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:54.941730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:54.949429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:54.950907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:16:54.965487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:54.967307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:54.968480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 630/1253] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:16:54.973305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:55.082921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9a72-3e16-4b62-9e9b-df32726fcddc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:55.118076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:55.118767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:55.119044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:55.119318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:55.120149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:55.120451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:55.121890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:55.138792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 624/1254] 10.222.0.84 () {56 vars in 1143 bytes} [Fri May 13 18:16:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:55.145718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:55.252328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380b734-21be-4ef2-a2d9-be2e715d04cd None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:55.289770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:55.290535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:55.290734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:55.291011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:55.361539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:55.362947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:55.464092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 631/1255] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:16:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:16:55.470050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:55.574960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ad5e-0de9-4e68-8183-58197c3c612a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:55.611815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:55.612611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:55.612899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:55.613172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:55.625334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:55.626862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:55.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:55.648394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:55.649304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:55.649304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:55.649304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:55.649304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:55.649304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 625/1256] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:55.654493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:55.757378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4df2e9-02a6-422c-8097-ee0339334c27 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:55.792271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:55.792891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:55.793168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:55.793436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:55.794225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:55.794531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:55.795918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:55.808267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 632/1257] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:55.814041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:55.915909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b66ea-6550-48cc-9827-889db53d922d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:55.950303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:55.951111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:55.951388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:55.951664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:55.959620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:55.961295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:16:55.976515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:55.978205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:16:55.979371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 626/1258] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:55.986379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:56.092491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f8b4-2595-498c-a354-9f3a4dc87f15 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:56.125700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:56.126397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:56.126681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:56.127563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:56.128355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:56.128662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:56.130123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b10a-d66f-4399-90ca-9ad567c9d332 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:56.144099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 633/1259] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:56.150312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:56.248781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a3e7-ee41-494d-a143-005743f9588d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:56.281832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:56.282492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:56.282775 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:56.283080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:56.283910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=bf69e911e669406982a5943d7841993e) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:56.284219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:56.285669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf76512-77d3-4ed1-8218-ea3f59811686 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:56.291106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 627/1260] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:16:56 2022] GET /identity/v3/role_assignments?user.id=bf69e911e669406982a5943d7841993e&scope.project.id=31dac20388d84281bab425701bac98be&role.id=86c6955a20734baf912fede27a24309e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:58.475658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68a413-0c15-41dc-a7a3-412215f9eced None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:58.476128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68a413-0c15-41dc-a7a3-412215f9eced None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:58.476252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68a413-0c15-41dc-a7a3-412215f9eced None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:58.477546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 634/1261] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:16:58.482841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:58.483261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:58.483380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:58.499718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:16:58.500859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:16:58.563470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 628/1262] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:16:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:16:58.586604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68a413-0c15-41dc-a7a3-412215f9eced None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:58.682072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68a413-0c15-41dc-a7a3-412215f9eced None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:58.713546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:58.714282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:58.714559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:58.714829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:58.724310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:16:58.731781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:58.732723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:58.733593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 635/1263] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:58.740551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:58.839350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64981-2374-4798-bb35-90249d5a1653 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:58.873216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:58.873902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:58.874187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:58.874465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:58.875209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:58.875515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:58.877473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:58.885241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 629/1264] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:58.891160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:58.995634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905e5c-b107-4d9a-aec3-84c155efa209 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:59.041254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:59.042628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:59.042951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:59.043401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:59.056629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:59.058109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:59.074996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:59.076042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:59.077197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:59.077197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:59.077197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:59.077197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:59.077197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 636/1265] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:59.082135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:59.179712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f892af-767e-41a0-b175-5581c6250d56 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:59.211430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:59.212078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:59.212360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:59.212634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:59.213344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:59.213646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:59.215039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:59.226720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 630/1266] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:59.232400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:59.327916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f2bd-ce51-4425-a048-e6a6eae8d890 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:59.360419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:59.361398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:59.361684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:59.361984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:59.369501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:59.370996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:16:59.385912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:59.387099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 18:16:59.388373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:59.389975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 637/1267] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:59.393578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:59.490118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c547-9b15-473d-9106-a53726da3c88 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:59.523067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:59.523725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:59.524009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:59.524286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:59.525127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:59.525440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:59.526888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:59.543625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 631/1268] 10.222.0.84 () {56 vars in 1143 bytes} [Fri May 13 18:16:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:59.550110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:59.646822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d879e-58d0-41e4-8f2d-20891cef0c2c None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:59.678011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:59.678823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:59.679106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:59.679382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:59.689835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:59.691283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:16:59.708297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:16:59.709435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:16:59.715206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:16:59.715206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:16:59.715206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:16:59.715206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:16:59.715206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 638/1269] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:16:59.715493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:59.812339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f991a-20eb-4f1b-9b14-f8fe286e8719 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:16:59.846765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:16:59.847423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:16:59.847703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:16:59.847975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:16:59.848695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:16:59.849001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:16:59.850408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:16:59.861900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 632/1270] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:16:59.867858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:16:59.966182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835e4d9-1749-4bc1-8730-f7f011caf1d6 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:00.006143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:00.006932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:00.007215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:00.007492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:00.014089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:00.015527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:17:00.029975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:00.031039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:17:00.032146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 639/1271] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:17:00.037309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:00.134098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35425474-d7b9-43f2-97ff-30b10ea811e5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:00.164778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:00.165426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:00.165706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:00.166012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:00.166789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:00.167094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:00.168513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2983470-a731-4fcf-a7c0-51ee69c14c75 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:00.188261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 633/1272] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:17:00.195286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:00.288975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db8f03-a301-4b03-b73a-9e6abfc19e4f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:00.320776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247227b-43e0-4e87-b5b5-73cd1543c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:00.321658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247227b-43e0-4e87-b5b5-73cd1543c0e7 None admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:00.321974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247227b-43e0-4e87-b5b5-73cd1543c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:00.322247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247227b-43e0-4e87-b5b5-73cd1543c0e7 None admin] PATH_INFO: `/v3/projects/31dac20388d84281bab425701bac98be/users/bf69e911e669406982a5943d7841993e/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:00.324151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247227b-43e0-4e87-b5b5-73cd1543c0e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=31dac20388d84281bab425701bac98be, user_id=bf69e911e669406982a5943d7841993e, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:00.325573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247227b-43e0-4e87-b5b5-73cd1543c0e7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:00.337848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 640/1273] 10.222.0.84 () {58 vars in 1439 bytes} [Fri May 13 18:17:00 2022] PUT /identity/v3/projects/31dac20388d84281bab425701bac98be/users/bf69e911e669406982a5943d7841993e/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:17:02.556689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7df77-88f9-4432-b00f-e906b09c880e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:02.557249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7df77-88f9-4432-b00f-e906b09c880e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:02.557249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7df77-88f9-4432-b00f-e906b09c880e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:02.558639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 634/1274] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:17:02.565089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:02.565559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:02.565747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:02.582596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:17:02.583782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:17:02.646891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 641/1275] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:17:02.671039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7df77-88f9-4432-b00f-e906b09c880e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:02.767824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7df77-88f9-4432-b00f-e906b09c880e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:02.799970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:02.800754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:02.801033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:02.801304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:02.810973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 18:17:02.819197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:02.820415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:02.821565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 635/1276] 10.222.0.84 () {56 vars in 1096 bytes} [Fri May 13 18:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:02.826381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:02.918496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772ef6-8b32-4a28-8a29-c56f98bcea5c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:02.950222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:02.950879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:02.951164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:02.951444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:02.952190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:02.952499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:02.953889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:02.962212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 642/1277] 10.222.0.84 () {56 vars in 1099 bytes} [Fri May 13 18:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:02.967904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:03.068367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f7a13-04fb-4253-8029-bc40d926dd8f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:03.100133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:03.101245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:03.101245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:03.101581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:03.111722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:03.113140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:17:03.129742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:03.130864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:03.131962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:17:03.131962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:17:03.131962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:17:03.131962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:03.131962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 636/1278] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:03.136792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:03.233738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc4b9-5e5e-4fea-bf67-d381424cb311 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:03.267770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:03.268427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:03.268712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:03.268995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:03.269714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:03.270048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:03.271409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:03.282744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 643/1279] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:03.288824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:03.383529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6502-fb1a-4e71-a58b-3ecc3991b21d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:03.414667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:03.415454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:03.415729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:03.415997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:03.424109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:03.425539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 18:17:03.439644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:03.440690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:03.441676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 637/1280] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:17:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:03.446635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:03.540928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713984f-ebcc-46a8-96f8-7eed78f5b30f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:03.573811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:03.574452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:03.574665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:03.574939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:03.575776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:03.576084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:03.577505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:03.594613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 644/1281] 10.222.0.84 () {56 vars in 1143 bytes} [Fri May 13 18:17:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:03.600657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:03.697128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321aa28-760a-43c1-bf6a-304bd73ba660 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:03.730238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:03.730881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:03.731164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:03.731437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:03.796832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:03.798848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:03.893763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 638/1282] 10.222.0.84 () {58 vars in 1282 bytes} [Fri May 13 18:17:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 18:17:03.899673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:03.995153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505c9e8-0551-4d12-aa10-e7219bb224ec None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:04.028036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:04.028816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:04.029095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:04.029370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:04.038989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:04.040409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 18:17:04.057335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:04.058456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:04.059598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 18:17:04.059598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 18:17:04.059598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 18:17:04.059598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:17:04.059598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 645/1283] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:04.064987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:04.159437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44cd8f-c037-400f-87bd-8a5da0fe3ba6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:04.192052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:04.192700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:04.192983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:04.193258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:04.194002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:04.194309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:04.195668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:04.207292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 639/1284] 10.222.0.84 () {56 vars in 1109 bytes} [Fri May 13 18:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:04.212984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:04.308543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78666146-d4de-49d9-a324-4a96535c0aad None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:04.341447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:04.342257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:04.342542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:04.342815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:04.349197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:04.350658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 18:17:04.364355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application with Lock( May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:04.365410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: ERROR keystone.server.flask.application May 13 18:17:04.366872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 646/1285] 10.222.0.84 () {56 vars in 1111 bytes} [Fri May 13 18:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:04.371389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:04.465968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ff947-0e6e-4018-88b6-3c378ef49856 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:04.498691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:04.499337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:04.499620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:04.499892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:04.500694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:04.500982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:04.503125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2db3ff-add6-4e43-80d4-6c827b1564f1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:04.514540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 640/1286] 10.222.0.84 () {56 vars in 1148 bytes} [Fri May 13 18:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:04.520699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:04.620390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c55f6-be45-417a-b97d-0b7546ea52c7 None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:04.653464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:04.654136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:04.654421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:04.654699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:04.655527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] RBAC: Adding query filter params (role.id=86c6955a20734baf912fede27a24309e, scope.project.id=31dac20388d84281bab425701bac98be, user.id=bf69e911e669406982a5943d7841993e) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:04.655836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:04.657253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678ddac-8384-41dd-9342-e1fa47e9cf02 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:04.663400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 647/1287] 10.222.0.84 () {56 vars in 1374 bytes} [Fri May 13 18:17:04 2022] GET /identity/v3/role_assignments?user.id=bf69e911e669406982a5943d7841993e&scope.project.id=31dac20388d84281bab425701bac98be&role.id=86c6955a20734baf912fede27a24309e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:06.908333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108c97a-043d-4448-84d6-a4c221354b92 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:06.908870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108c97a-043d-4448-84d6-a4c221354b92 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:06.908870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108c97a-043d-4448-84d6-a4c221354b92 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:06.910301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 641/1288] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:17:06.915506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:06.915919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:06.916069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:06.932755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:17:06.933977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:17:07.005517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 648/1289] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:17:07.029852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108c97a-043d-4448-84d6-a4c221354b92 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:07.135279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108c97a-043d-4448-84d6-a4c221354b92 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:07.168915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:07.169627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:07.169941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:07.170219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] PATH_INFO: `/v3/services/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:07.170863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:07.172239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:07.184906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:07.186148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:07.187319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:07.190162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 642/1290] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:17:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 18:17:07.192775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:07.286036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49c86-20e8-4655-af94-76d7a0150931 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:07.318356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:07.319011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:07.319293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:07.319568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:07.320267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:07.320572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:07.321963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be04ac-e8f8-4c1c-ba00-ef6f8976e6ca None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:07.326599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 649/1291] 10.222.0.84 () {56 vars in 1116 bytes} [Fri May 13 18:17:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:07.332883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:07.431545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8220402-91ee-4d09-8f77-290b618df4df None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:07.466701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:07.467424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:07.467708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:07.467988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:07.468698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:07.469001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:07.471438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aecc0-95e0-4f25-8b30-9d58160dc5c1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:07.476060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 643/1292] 10.222.0.84 () {56 vars in 1116 bytes} [Fri May 13 18:17:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:09.692417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcd28-e4bf-43a3-ac7a-cd6cdf80317b None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:09.692979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcd28-e4bf-43a3-ac7a-cd6cdf80317b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:09.692979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcd28-e4bf-43a3-ac7a-cd6cdf80317b None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:09.694382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 650/1293] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:17:09.699612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfe88c-f326-4a36-9da1-c2a3b15c4e0d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:09.700028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfe88c-f326-4a36-9da1-c2a3b15c4e0d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:09.700164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfe88c-f326-4a36-9da1-c2a3b15c4e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:09.716244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-18cfe88c-f326-4a36-9da1-c2a3b15c4e0d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:17:09.717341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-18cfe88c-f326-4a36-9da1-c2a3b15c4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:17:09.779803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 644/1294] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:17:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:17:09.802795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcd28-e4bf-43a3-ac7a-cd6cdf80317b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:09.900204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcd28-e4bf-43a3-ac7a-cd6cdf80317b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:09.931998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3d89-3f23-4752-9f44-f6ab175c4c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:09.932646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3d89-3f23-4752-9f44-f6ab175c4c64 None admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:09.932922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3d89-3f23-4752-9f44-f6ab175c4c64 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:09.933190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3d89-3f23-4752-9f44-f6ab175c4c64 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:09.933920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3d89-3f23-4752-9f44-f6ab175c4c64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:09.935263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3d89-3f23-4752-9f44-f6ab175c4c64 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:09.949151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 651/1295] 10.222.0.84 () {60 vars in 1141 bytes} [Fri May 13 18:17:09 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:17:12.199382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77909-158b-4ffd-b3c4-3e68078001f1 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:12.199984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77909-158b-4ffd-b3c4-3e68078001f1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:12.199984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77909-158b-4ffd-b3c4-3e68078001f1 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:12.201301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 645/1296] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:17:12.207136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:12.207631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:12.207732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:12.224531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:17:12.225699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:17:12.295275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 652/1297] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:17:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:17:12.318627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77909-158b-4ffd-b3c4-3e68078001f1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:12.413934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77909-158b-4ffd-b3c4-3e68078001f1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:12.447580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:12.448366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:12.448653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:12.448926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:12.449638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:12.450973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:12.463619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:12.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:12.465867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 646/1298] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:17:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:12.471867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:12.569121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8e056-169e-4269-9ee9-f47bb52ee17f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:12.601614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:12.602298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:12.602581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:12.602856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:12.603560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] RBAC: Adding query filter params (name=placement) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:12.603866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:12.605221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:12.610936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 653/1299] 10.222.0.84 () {56 vars in 1116 bytes} [Fri May 13 18:17:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:12.617479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:12.711411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7bfe8-e0dd-4592-8bef-471b56bbf264 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:12.742685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:12.743316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:12.743593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:12.743869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:12.744647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] RBAC: Adding query filter params (interface=public, service_id=9b34a49e99f042d682717f06bf93d6f2, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:12.744955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:12.746325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69b2d2-092f-4e47-9758-2e866d9f7a90 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:12.751664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 647/1300] 10.222.0.84 () {56 vars in 1251 bytes} [Fri May 13 18:17:12 2022] GET /identity/v3/endpoints?service_id=9b34a49e99f042d682717f06bf93d6f2&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:12.757395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:12.853341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf496-97ce-4a32-9802-cbb7d723261f None admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:12.886854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eecd88-4593-4be0-86d5-c6fcd9f467c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:12.887511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eecd88-4593-4be0-86d5-c6fcd9f467c4 None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:12.887798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eecd88-4593-4be0-86d5-c6fcd9f467c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:12.888075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eecd88-4593-4be0-86d5-c6fcd9f467c4 None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:12.888753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eecd88-4593-4be0-86d5-c6fcd9f467c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:12.890141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eecd88-4593-4be0-86d5-c6fcd9f467c4 None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:12.897100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 654/1301] 10.222.0.84 () {56 vars in 1087 bytes} [Fri May 13 18:17:12 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:17:15.085977 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a0349-685f-4859-8e62-9e3de9bf4f6d None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:15.086524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a0349-685f-4859-8e62-9e3de9bf4f6d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:15.086524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a0349-685f-4859-8e62-9e3de9bf4f6d None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:15.087904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 648/1302] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:17:15.093241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:15.093716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:15.093849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:15.111291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:17:15.112628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:17:15.177400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 655/1303] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:17:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 18:17:15.200354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a0349-685f-4859-8e62-9e3de9bf4f6d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:15.297635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a0349-685f-4859-8e62-9e3de9bf4f6d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:15.330258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:15.331038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:15.331316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:15.331589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:15.332228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:15.333567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 18:17:15.345993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 18:17:15.347169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 13 18:17:15.348071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 649/1304] 10.222.0.84 () {56 vars in 1117 bytes} [Fri May 13 18:17:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 18:17:15.353125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:15.445989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ce84b-f7e5-4e9a-a79b-19ac4fc7ee2d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:15.478974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:15.479645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:15.479930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:15.480212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] PATH_INFO: `/v3/services` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:15.480919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:17:15.481227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:15.482639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599aa31-3e7f-4a67-8ed2-b0f138313a3f None admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:15.488604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 656/1305] 10.222.0.84 () {56 vars in 1116 bytes} [Fri May 13 18:17:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:17:15.494470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:17:15.590010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82f35e-15ba-4308-b6d6-cda2561481e6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:17:15.621580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f1904-c0ac-410a-95e0-0f2b660e4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:17:15.622189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f1904-c0ac-410a-95e0-0f2b660e4c66 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:17:15.622475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f1904-c0ac-410a-95e0-0f2b660e4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:17:15.622754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f1904-c0ac-410a-95e0-0f2b660e4c66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:17:15.623499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f1904-c0ac-410a-95e0-0f2b660e4c66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:17:15.624850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f1904-c0ac-410a-95e0-0f2b660e4c66 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:17:15.644102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 650/1306] 10.222.0.84 () {60 vars in 1144 bytes} [Fri May 13 18:17:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:18:20.363870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234d72e-6131-476d-9f81-f275d8b0724e None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:20.363870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234d72e-6131-476d-9f81-f275d8b0724e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:20.363870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234d72e-6131-476d-9f81-f275d8b0724e None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:20.370266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93267d5-2ea4-474f-b928-e3ef459687a5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:20.371149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93267d5-2ea4-474f-b928-e3ef459687a5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:20.371637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93267d5-2ea4-474f-b928-e3ef459687a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:20.375424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 657/1307] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:20.448183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a93267d5-2ea4-474f-b928-e3ef459687a5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:20.449383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a93267d5-2ea4-474f-b928-e3ef459687a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:20.560009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 651/1308] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:20.631697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2807d6-e593-4376-926a-80a502f982c1 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:20.631985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2807d6-e593-4376-926a-80a502f982c1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:20.632589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2807d6-e593-4376-926a-80a502f982c1 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:20.634225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 658/1309] 10.222.0.84 () {54 vars in 964 bytes} [Fri May 13 18:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:20.649120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a7b02-d8d5-44cd-a35d-ed9cd012b60b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:20.649410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a7b02-d8d5-44cd-a35d-ed9cd012b60b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:20.649690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a7b02-d8d5-44cd-a35d-ed9cd012b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:20.757710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-746a7b02-d8d5-44cd-a35d-ed9cd012b60b None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:20.758959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-746a7b02-d8d5-44cd-a35d-ed9cd012b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:20.852785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 652/1310] 10.222.0.84 () {58 vars in 1061 bytes} [Fri May 13 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:20.863797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2807d6-e593-4376-926a-80a502f982c1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:20.865963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6a2807d6-e593-4376-926a-80a502f982c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:21.014093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2807d6-e593-4376-926a-80a502f982c1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:21.089693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:21.090371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:21.090653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:21.090925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:21.093262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:21.209019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:21.210484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ddea3-c887-46c8-b04e-d2979f7acb73 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:21.231368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 659/1311] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:23.791446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd478f4-2282-45b5-aa8a-68972d3cca3c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:23.792116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd478f4-2282-45b5-aa8a-68972d3cca3c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:23.792116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd478f4-2282-45b5-aa8a-68972d3cca3c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:23.793446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 653/1312] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:23.799723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baadede-966e-42e4-af4a-f7321af6ee74 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:23.800182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baadede-966e-42e4-af4a-f7321af6ee74 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:23.800264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baadede-966e-42e4-af4a-f7321af6ee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:23.884947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8baadede-966e-42e4-af4a-f7321af6ee74 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:23.886115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8baadede-966e-42e4-af4a-f7321af6ee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:23.992374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 660/1313] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:24.042496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12662-d10a-4c6d-a3f6-e639829420b0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:24.042848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12662-d10a-4c6d-a3f6-e639829420b0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:24.043232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12662-d10a-4c6d-a3f6-e639829420b0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:24.044726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 654/1314] 10.222.0.84 () {54 vars in 964 bytes} [Fri May 13 18:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:24.051621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc90d7-29c3-464e-a963-ee26182f422d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:24.051916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc90d7-29c3-464e-a963-ee26182f422d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:24.052196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc90d7-29c3-464e-a963-ee26182f422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:24.127211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-66fc90d7-29c3-464e-a963-ee26182f422d None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:24.128431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-66fc90d7-29c3-464e-a963-ee26182f422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:24.206630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 661/1315] 10.222.0.84 () {58 vars in 1061 bytes} [Fri May 13 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:24.215988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad12662-d10a-4c6d-a3f6-e639829420b0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:24.217676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5ad12662-d10a-4c6d-a3f6-e639829420b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:24.325249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad12662-d10a-4c6d-a3f6-e639829420b0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:24.404206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:24.405987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:24.406421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:24.406845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:24.408657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:24.527550 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:24.528994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b954b4-f2c2-4721-b1cf-29b238b31993 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:24.550157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 655/1316] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:27.378762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d05b3-7805-4346-bdaf-45e0a0f66fcd None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:27.379333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d05b3-7805-4346-bdaf-45e0a0f66fcd None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:27.379333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d05b3-7805-4346-bdaf-45e0a0f66fcd None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:27.380670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 662/1317] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:27.386131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8f84-df1a-4cc0-9bc8-85d881151fe7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:27.386623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8f84-df1a-4cc0-9bc8-85d881151fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:27.386722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8f84-df1a-4cc0-9bc8-85d881151fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:27.454099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-631f8f84-df1a-4cc0-9bc8-85d881151fe7 None None] MFA Rules not processed for user `51f6a62015a94fde8755dbb4c39831e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:27.455295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-631f8f84-df1a-4cc0-9bc8-85d881151fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:27.553475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 656/1318] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:27.596533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d05b3-7805-4346-bdaf-45e0a0f66fcd None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:27.598137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fa8d05b3-7805-4346-bdaf-45e0a0f66fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:27.702689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d05b3-7805-4346-bdaf-45e0a0f66fcd None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:27.772822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:27.773466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:27.773748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:27.774050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:27.775709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:27.882694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:27.884047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9659a-6928-456f-b23e-13302152dfbd service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:27.902558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 663/1319] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:30.690120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30fd0-4570-4e02-b90b-c349610ca05d None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:30.690633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30fd0-4570-4e02-b90b-c349610ca05d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:30.690633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30fd0-4570-4e02-b90b-c349610ca05d None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:30.691955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 657/1320] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:30.697203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110a51-d611-4876-8771-4b14c19ea66b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:30.697618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110a51-d611-4876-8771-4b14c19ea66b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:30.697790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110a51-d611-4876-8771-4b14c19ea66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:30.761829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e1110a51-d611-4876-8771-4b14c19ea66b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:30.763046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e1110a51-d611-4876-8771-4b14c19ea66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:30.862442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 664/1321] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:30.901066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30fd0-4570-4e02-b90b-c349610ca05d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:30.902680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9bd30fd0-4570-4e02-b90b-c349610ca05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:31.005904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30fd0-4570-4e02-b90b-c349610ca05d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:31.075081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:31.075725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:31.076008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:31.076287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:31.078687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:31.185497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:31.187505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85434a9-1319-4bdd-a16c-9199573c1097 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:31.205949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 658/1322] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:34.248387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771a99-f5da-466e-b39d-665abfb63249 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:34.249602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771a99-f5da-466e-b39d-665abfb63249 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:34.249602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771a99-f5da-466e-b39d-665abfb63249 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:34.250847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 665/1323] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:34.256175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023133e0-93f3-485d-80b7-46cdd49fb63a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:34.256594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023133e0-93f3-485d-80b7-46cdd49fb63a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:34.256881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023133e0-93f3-485d-80b7-46cdd49fb63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:34.321654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-023133e0-93f3-485d-80b7-46cdd49fb63a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:34.322871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-023133e0-93f3-485d-80b7-46cdd49fb63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:34.418690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 659/1324] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:34.456015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771a99-f5da-466e-b39d-665abfb63249 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:34.457561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0c771a99-f5da-466e-b39d-665abfb63249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:34.559056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771a99-f5da-466e-b39d-665abfb63249 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:34.632001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:34.632656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:34.632940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:34.633220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:34.634925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:34.741175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:34.742645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77905aba-0eb2-48bc-b229-57d8a61adc2a service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:34.760887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 666/1325] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:37.048845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae2c2-2897-4e96-98af-cfe8da9860cd None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:37.049524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae2c2-2897-4e96-98af-cfe8da9860cd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:37.049524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae2c2-2897-4e96-98af-cfe8da9860cd None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:37.050852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 660/1326] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:37.056814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f88fed-d1ac-4d4f-aa60-b1bffa6bc312 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:37.057381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f88fed-d1ac-4d4f-aa60-b1bffa6bc312 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:37.057492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f88fed-d1ac-4d4f-aa60-b1bffa6bc312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:37.123335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a4f88fed-d1ac-4d4f-aa60-b1bffa6bc312 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:37.125460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a4f88fed-d1ac-4d4f-aa60-b1bffa6bc312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:37.226017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 667/1327] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:37.261748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae2c2-2897-4e96-98af-cfe8da9860cd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:37.263288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-372ae2c2-2897-4e96-98af-cfe8da9860cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:37.367985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae2c2-2897-4e96-98af-cfe8da9860cd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:37.440244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:37.440890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:37.441174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:37.441448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:37.443127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:37.552752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:37.554229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c343038-5632-4123-ab24-ae1e2d693787 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:37.572847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 661/1328] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:39.864266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222806c-a6a7-4842-aa1d-e9577c4a74b6 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:39.864807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222806c-a6a7-4842-aa1d-e9577c4a74b6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:39.864807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222806c-a6a7-4842-aa1d-e9577c4a74b6 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:39.866340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 668/1329] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:18:39.872021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c16402-906d-4278-b269-9fd3ef54f674 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:39.872434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c16402-906d-4278-b269-9fd3ef54f674 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:39.872583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c16402-906d-4278-b269-9fd3ef54f674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:39.940321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-66c16402-906d-4278-b269-9fd3ef54f674 None None] MFA Rules not processed for user `51f6a62015a94fde8755dbb4c39831e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:39.941509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-66c16402-906d-4278-b269-9fd3ef54f674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:40.036595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 662/1330] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:40.073875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222806c-a6a7-4842-aa1d-e9577c4a74b6 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:40.075405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f222806c-a6a7-4842-aa1d-e9577c4a74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:40.181953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222806c-a6a7-4842-aa1d-e9577c4a74b6 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:40.254549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:40.255204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:40.255487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:40.255764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:40.257418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:40.368415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:40.369898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28349f-14c9-4f9a-b1b5-8b4e3e0e2a26 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:40.388972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 669/1331] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:43.030982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392dc95-222b-4621-9fdf-ee780a6560c2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:43.031548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392dc95-222b-4621-9fdf-ee780a6560c2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:43.031548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392dc95-222b-4621-9fdf-ee780a6560c2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:43.032928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 663/1332] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:43.038320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb69d3c-9702-4632-904e-91fb8e00b099 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:43.038778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb69d3c-9702-4632-904e-91fb8e00b099 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:43.038883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb69d3c-9702-4632-904e-91fb8e00b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:43.101732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9cb69d3c-9702-4632-904e-91fb8e00b099 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:43.102881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9cb69d3c-9702-4632-904e-91fb8e00b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:43.197295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 670/1333] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:43.234217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392dc95-222b-4621-9fdf-ee780a6560c2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:43.235988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9392dc95-222b-4621-9fdf-ee780a6560c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:43.341257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392dc95-222b-4621-9fdf-ee780a6560c2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:43.415032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:43.415675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:43.415961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:43.416233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:43.417915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:43.536785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:43.538288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739b7c6-d674-4d87-b2d0-756b840afc94 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:43.558149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 664/1334] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:45.862528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8ec3-6a65-4558-974c-fed4bc7943e7 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:45.863073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8ec3-6a65-4558-974c-fed4bc7943e7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:45.863073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8ec3-6a65-4558-974c-fed4bc7943e7 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:45.864448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 671/1335] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:45.869650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc58cd-e528-4241-b7f3-43b147ae3601 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:45.870139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc58cd-e528-4241-b7f3-43b147ae3601 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:45.870244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc58cd-e528-4241-b7f3-43b147ae3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:45.933746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f4fc58cd-e528-4241-b7f3-43b147ae3601 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:45.934980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f4fc58cd-e528-4241-b7f3-43b147ae3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:46.032558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 665/1336] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:46.072843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8ec3-6a65-4558-974c-fed4bc7943e7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:46.074451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b68b8ec3-6a65-4558-974c-fed4bc7943e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:46.175692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8ec3-6a65-4558-974c-fed4bc7943e7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:46.246650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:46.247297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:46.247576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:46.247850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:46.250375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:46.357731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:46.359671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d3d9c-15ad-4e37-9a2a-75f1e6af5447 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:46.378455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 672/1337] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:49.057646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ecdb-3f1a-455d-b6ec-b79cdc2820ba None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:49.058263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ecdb-3f1a-455d-b6ec-b79cdc2820ba None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:49.058263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ecdb-3f1a-455d-b6ec-b79cdc2820ba None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:49.059597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 666/1338] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:49.065196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9b78-9dac-4850-a84d-dbfb98afbde3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:49.065625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9b78-9dac-4850-a84d-dbfb98afbde3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:49.065746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9b78-9dac-4850-a84d-dbfb98afbde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:49.127291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-727e9b78-9dac-4850-a84d-dbfb98afbde3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:49.128462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-727e9b78-9dac-4850-a84d-dbfb98afbde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:49.218690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 673/1339] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:18:49.253763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ecdb-3f1a-455d-b6ec-b79cdc2820ba None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:49.255317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17a1ecdb-3f1a-455d-b6ec-b79cdc2820ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:49.355319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ecdb-3f1a-455d-b6ec-b79cdc2820ba None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:49.426204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:49.426850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:49.427131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:49.427405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:49.429043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:49.537028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:49.538494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7b42-e131-40d4-ab84-ac58cb0eb9a8 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:49.556432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 667/1340] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:53.927997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a3b8-9684-48dc-98bc-dbbf1078f41a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:53.928535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a3b8-9684-48dc-98bc-dbbf1078f41a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:53.928626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a3b8-9684-48dc-98bc-dbbf1078f41a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:53.930013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 674/1341] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:53.935433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbcd3d-f7d6-4bfe-800f-9f6625fb7dc7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:53.935845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbcd3d-f7d6-4bfe-800f-9f6625fb7dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:53.936060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbcd3d-f7d6-4bfe-800f-9f6625fb7dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:54.007991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-71dbcd3d-f7d6-4bfe-800f-9f6625fb7dc7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:54.009088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-71dbcd3d-f7d6-4bfe-800f-9f6625fb7dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:54.110936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 668/1342] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:54.149438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a3b8-9684-48dc-98bc-dbbf1078f41a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:54.151523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-64e4a3b8-9684-48dc-98bc-dbbf1078f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:54.246222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a3b8-9684-48dc-98bc-dbbf1078f41a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:54.250432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786ecb9-1b98-4c4a-b276-96a7f7d3b402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:54.251080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786ecb9-1b98-4c4a-b276-96a7f7d3b402 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:54.251365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786ecb9-1b98-4c4a-b276-96a7f7d3b402 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:54.251641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786ecb9-1b98-4c4a-b276-96a7f7d3b402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:54.260761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786ecb9-1b98-4c4a-b276-96a7f7d3b402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:54.262238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786ecb9-1b98-4c4a-b276-96a7f7d3b402 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:54.272001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 675/1343] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:18:57.102611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038a695-8daa-4ba7-98d4-e7b594c40f12 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:57.103122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038a695-8daa-4ba7-98d4-e7b594c40f12 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:57.103122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038a695-8daa-4ba7-98d4-e7b594c40f12 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:57.104464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 669/1344] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:18:57.110145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9102-e2ca-419b-8d68-8ba326bda576 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:57.110570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9102-e2ca-419b-8d68-8ba326bda576 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:57.110713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9102-e2ca-419b-8d68-8ba326bda576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:57.138708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-270e9102-e2ca-419b-8d68-8ba326bda576 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:18:57.139832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-270e9102-e2ca-419b-8d68-8ba326bda576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:18:57.216760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 676/1345] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:18:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:18:57.256700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038a695-8daa-4ba7-98d4-e7b594c40f12 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:18:57.267233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038a695-8daa-4ba7-98d4-e7b594c40f12 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:18:57.270717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa63d-4ec2-41ba-8a12-47156fe55ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:18:57.271344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa63d-4ec2-41ba-8a12-47156fe55ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:18:57.271623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa63d-4ec2-41ba-8a12-47156fe55ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:18:57.271897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa63d-4ec2-41ba-8a12-47156fe55ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:18:57.281244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa63d-4ec2-41ba-8a12-47156fe55ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:18:57.282704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa63d-4ec2-41ba-8a12-47156fe55ca1 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:18:57.292054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 670/1346] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:18:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:01.639059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c508240-56f0-4440-b460-cd27d33bd682 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:01.639607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c508240-56f0-4440-b460-cd27d33bd682 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:01.639607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c508240-56f0-4440-b460-cd27d33bd682 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:01.641901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 677/1347] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:01.648052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187e8c-1411-41fc-a51a-c8ed28403329 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:01.648586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187e8c-1411-41fc-a51a-c8ed28403329 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:01.648586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187e8c-1411-41fc-a51a-c8ed28403329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:01.666928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ca187e8c-1411-41fc-a51a-c8ed28403329 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:01.668025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ca187e8c-1411-41fc-a51a-c8ed28403329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:01.676597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 671/1348] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:01.714344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c508240-56f0-4440-b460-cd27d33bd682 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:01.725063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c508240-56f0-4440-b460-cd27d33bd682 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:01.728738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62ad9b-3a04-421c-9ee3-fcfca54de66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:01.729382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62ad9b-3a04-421c-9ee3-fcfca54de66f service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:01.729660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62ad9b-3a04-421c-9ee3-fcfca54de66f service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:01.729963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62ad9b-3a04-421c-9ee3-fcfca54de66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:01.740034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62ad9b-3a04-421c-9ee3-fcfca54de66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:01.741509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62ad9b-3a04-421c-9ee3-fcfca54de66f service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:01.751667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 678/1349] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:07.209467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94934c7-aed8-4249-84a9-42fbb88c173a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:07.210012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94934c7-aed8-4249-84a9-42fbb88c173a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:07.210111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94934c7-aed8-4249-84a9-42fbb88c173a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:07.211431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 672/1350] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:07.216614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20203-880e-4ae3-97d1-743cdb37bc9f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:07.217409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20203-880e-4ae3-97d1-743cdb37bc9f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:07.217924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20203-880e-4ae3-97d1-743cdb37bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:07.473009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-59b20203-880e-4ae3-97d1-743cdb37bc9f None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:07.474473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-59b20203-880e-4ae3-97d1-743cdb37bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:07.571267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 679/1351] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:19:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:11.815491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4305b-038a-48ad-bff6-d88f58976e31 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:11.816423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4305b-038a-48ad-bff6-d88f58976e31 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:11.816937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4305b-038a-48ad-bff6-d88f58976e31 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:11.818865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 673/1352] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:11.823982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f91a4-4eaf-4adf-adfc-91ff7c649044 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:11.824497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f91a4-4eaf-4adf-adfc-91ff7c649044 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:11.824497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f91a4-4eaf-4adf-adfc-91ff7c649044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:11.845876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9d2f91a4-4eaf-4adf-adfc-91ff7c649044 None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:11.847439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9d2f91a4-4eaf-4adf-adfc-91ff7c649044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:11.857256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 680/1353] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:13.498047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8ef52-32a7-47c5-8a84-22c74bcce834 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:13.498682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8ef52-32a7-47c5-8a84-22c74bcce834 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:13.498682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8ef52-32a7-47c5-8a84-22c74bcce834 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:13.500515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 674/1354] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:13.506064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bba6f-8388-46cb-ac88-d55d7e565c29 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:13.506506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bba6f-8388-46cb-ac88-d55d7e565c29 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:13.506759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bba6f-8388-46cb-ac88-d55d7e565c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:13.534367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b86bba6f-8388-46cb-ac88-d55d7e565c29 None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:13.535672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b86bba6f-8388-46cb-ac88-d55d7e565c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:13.544843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 681/1355] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:17.492447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ca94-3fa0-435a-94d1-a3d39b738345 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:17.493005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ca94-3fa0-435a-94d1-a3d39b738345 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:17.493841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ca94-3fa0-435a-94d1-a3d39b738345 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:17.496275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 675/1356] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:17.503117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a9559-c1cd-4890-8ee7-9b17130a36ac None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:17.503580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a9559-c1cd-4890-8ee7-9b17130a36ac None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:17.503705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a9559-c1cd-4890-8ee7-9b17130a36ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:17.522506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3a0a9559-c1cd-4890-8ee7-9b17130a36ac None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:17.523798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3a0a9559-c1cd-4890-8ee7-9b17130a36ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:17.533481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 682/1357] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:17.583415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938cbc-bdaf-464d-a48e-3db1b4d27343 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:17.583797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938cbc-bdaf-464d-a48e-3db1b4d27343 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:17.584475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938cbc-bdaf-464d-a48e-3db1b4d27343 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:17.587394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 676/1358] 10.222.0.84 () {54 vars in 961 bytes} [Fri May 13 18:19:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:17.594294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b390aa-da22-4f11-ba77-791a0d4344f5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:17.594816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b390aa-da22-4f11-ba77-791a0d4344f5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:17.595164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b390aa-da22-4f11-ba77-791a0d4344f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:17.644978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-24b390aa-da22-4f11-ba77-791a0d4344f5 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:17.646511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-24b390aa-da22-4f11-ba77-791a0d4344f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:17.727850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 683/1359] 10.222.0.84 () {58 vars in 1058 bytes} [Fri May 13 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:17.736439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938cbc-bdaf-464d-a48e-3db1b4d27343 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:17.750616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938cbc-bdaf-464d-a48e-3db1b4d27343 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:17.755994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0df2a9-ffc3-47bb-9e71-e5d9a55c6544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:17.756625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0df2a9-ffc3-47bb-9e71-e5d9a55c6544 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:17.756906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0df2a9-ffc3-47bb-9e71-e5d9a55c6544 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:17.757186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0df2a9-ffc3-47bb-9e71-e5d9a55c6544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:17.765594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0df2a9-ffc3-47bb-9e71-e5d9a55c6544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:17.767242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0df2a9-ffc3-47bb-9e71-e5d9a55c6544 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:17.777384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 677/1360] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:20.240191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b15fc-47f3-48fd-b612-ce80dec83ff2 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:20.240771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b15fc-47f3-48fd-b612-ce80dec83ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:20.240771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b15fc-47f3-48fd-b612-ce80dec83ff2 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:20.242120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 684/1361] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:20.247349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31cb71-7b33-4690-a7eb-ab2a99ac754d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:20.247778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31cb71-7b33-4690-a7eb-ab2a99ac754d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:20.247898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31cb71-7b33-4690-a7eb-ab2a99ac754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:20.266086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4f31cb71-7b33-4690-a7eb-ab2a99ac754d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:20.267275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4f31cb71-7b33-4690-a7eb-ab2a99ac754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:20.275275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 678/1362] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:20.319290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b15fc-47f3-48fd-b612-ce80dec83ff2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:20.334369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b15fc-47f3-48fd-b612-ce80dec83ff2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:20.339644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99e7e-f606-46fb-95b1-652c34dffc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:20.340292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99e7e-f606-46fb-95b1-652c34dffc34 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:20.340573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99e7e-f606-46fb-95b1-652c34dffc34 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:20.340855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99e7e-f606-46fb-95b1-652c34dffc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:20.350374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99e7e-f606-46fb-95b1-652c34dffc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:20.352509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99e7e-f606-46fb-95b1-652c34dffc34 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:20.362744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 685/1363] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:22.927089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a01c-fdb3-4271-bcf0-c29a982601c7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:22.927608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a01c-fdb3-4271-bcf0-c29a982601c7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:22.927702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a01c-fdb3-4271-bcf0-c29a982601c7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:22.929068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 679/1364] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:22.934494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8e57-80ea-43d6-bb6b-bd1056f90740 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:22.934925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8e57-80ea-43d6-bb6b-bd1056f90740 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:22.935050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8e57-80ea-43d6-bb6b-bd1056f90740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:22.952988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-258c8e57-80ea-43d6-bb6b-bd1056f90740 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:22.954221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-258c8e57-80ea-43d6-bb6b-bd1056f90740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:22.962750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 686/1365] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:23.013323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b292bf-d315-4d3e-bff4-b137f538e079 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:23.013615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b292bf-d315-4d3e-bff4-b137f538e079 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:23.013948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b292bf-d315-4d3e-bff4-b137f538e079 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:23.015500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 680/1366] 10.222.0.84 () {54 vars in 961 bytes} [Fri May 13 18:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:23.020702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2032-72bb-4a13-b3cd-8effe27332c3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:23.020993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2032-72bb-4a13-b3cd-8effe27332c3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:23.021269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2032-72bb-4a13-b3cd-8effe27332c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:23.040004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-05ad2032-72bb-4a13-b3cd-8effe27332c3 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:23.041181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-05ad2032-72bb-4a13-b3cd-8effe27332c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:23.051733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 687/1367] 10.222.0.84 () {58 vars in 1058 bytes} [Fri May 13 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:23.065897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b292bf-d315-4d3e-bff4-b137f538e079 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:23.080362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b292bf-d315-4d3e-bff4-b137f538e079 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:23.086930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b40dd-a2a5-4741-a7e9-5e691d356857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:23.087585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b40dd-a2a5-4741-a7e9-5e691d356857 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:23.087868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b40dd-a2a5-4741-a7e9-5e691d356857 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:23.088142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b40dd-a2a5-4741-a7e9-5e691d356857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:23.106187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b40dd-a2a5-4741-a7e9-5e691d356857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:23.108131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b40dd-a2a5-4741-a7e9-5e691d356857 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:23.125692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 681/1368] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:19:25.504579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bb09b-3c8c-4e44-96bd-ec78ca9d3afb None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:25.505135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bb09b-3c8c-4e44-96bd-ec78ca9d3afb None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:25.505135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bb09b-3c8c-4e44-96bd-ec78ca9d3afb None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:25.506647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 688/1369] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:25.512082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631fb4-2f01-421a-a841-c4da62806cbc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:25.512501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631fb4-2f01-421a-a841-c4da62806cbc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:25.512639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631fb4-2f01-421a-a841-c4da62806cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:25.530960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5f631fb4-2f01-421a-a841-c4da62806cbc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:25.532800 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5f631fb4-2f01-421a-a841-c4da62806cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:25.540588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 682/1370] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:25.586344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bb09b-3c8c-4e44-96bd-ec78ca9d3afb None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:25.601275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bb09b-3c8c-4e44-96bd-ec78ca9d3afb None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:25.607007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecec26a-62ca-474f-b330-040fd33d8005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:25.607651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec26a-62ca-474f-b330-040fd33d8005 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:25.607932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec26a-62ca-474f-b330-040fd33d8005 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:25.608202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec26a-62ca-474f-b330-040fd33d8005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:25.618393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecec26a-62ca-474f-b330-040fd33d8005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:25.619979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecec26a-62ca-474f-b330-040fd33d8005 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:25.631483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 689/1371] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:25.884524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe400e-e833-4955-ac48-d3c6e909341a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:25.884829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe400e-e833-4955-ac48-d3c6e909341a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:25.885069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe400e-e833-4955-ac48-d3c6e909341a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:25.886807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 683/1372] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:25.894684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffeb51-241d-43d4-b502-c1bd4f7c2aca None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:25.894978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffeb51-241d-43d4-b502-c1bd4f7c2aca None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:25.895465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffeb51-241d-43d4-b502-c1bd4f7c2aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:25.918273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f5ffeb51-241d-43d4-b502-c1bd4f7c2aca None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:25.919509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f5ffeb51-241d-43d4-b502-c1bd4f7c2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:25.929029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 690/1373] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:26.245050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfdbcf-fca9-4702-b867-19354dc5521f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:26.245050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfdbcf-fca9-4702-b867-19354dc5521f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:26.245050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfdbcf-fca9-4702-b867-19354dc5521f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:26.247892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 684/1374] 10.222.0.84 () {54 vars in 963 bytes} [Fri May 13 18:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:26.251822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7af87-c10a-4a11-96b0-c27dee9daa81 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:26.252112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7af87-c10a-4a11-96b0-c27dee9daa81 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:26.252389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7af87-c10a-4a11-96b0-c27dee9daa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:26.304579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2dc7af87-c10a-4a11-96b0-c27dee9daa81 None None] MFA Rules not processed for user `a50eb00b59c3432bb7c085d3d8287ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:26.305789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2dc7af87-c10a-4a11-96b0-c27dee9daa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:26.371322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 691/1375] 10.222.0.84 () {58 vars in 1060 bytes} [Fri May 13 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:26.379859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfdbcf-fca9-4702-b867-19354dc5521f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:26.392007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfdbcf-fca9-4702-b867-19354dc5521f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:26.395704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e3cc-9e5f-4c33-beee-eb797edb09f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:26.396419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e3cc-9e5f-4c33-beee-eb797edb09f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:26.396773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e3cc-9e5f-4c33-beee-eb797edb09f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:26.397120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e3cc-9e5f-4c33-beee-eb797edb09f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:26.407696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e3cc-9e5f-4c33-beee-eb797edb09f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:26.409219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e3cc-9e5f-4c33-beee-eb797edb09f1 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:26.419005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 685/1376] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:27.945142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf41118-addb-4d87-aad3-a985108471c5 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:27.945748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf41118-addb-4d87-aad3-a985108471c5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:27.945748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf41118-addb-4d87-aad3-a985108471c5 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:27.947226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 692/1377] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:27.953609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b6bce-8ef1-44be-b6ec-22c4d9bf313b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:27.954224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b6bce-8ef1-44be-b6ec-22c4d9bf313b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:27.954789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b6bce-8ef1-44be-b6ec-22c4d9bf313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:27.974000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f88b6bce-8ef1-44be-b6ec-22c4d9bf313b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:27.975231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f88b6bce-8ef1-44be-b6ec-22c4d9bf313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:27.986875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 686/1378] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:28.034633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf41118-addb-4d87-aad3-a985108471c5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:28.049958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf41118-addb-4d87-aad3-a985108471c5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:28.055631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd0532-c4d2-4c97-94a1-7607e311cec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:28.056306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd0532-c4d2-4c97-94a1-7607e311cec7 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:28.056591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd0532-c4d2-4c97-94a1-7607e311cec7 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:28.056869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd0532-c4d2-4c97-94a1-7607e311cec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:28.065873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd0532-c4d2-4c97-94a1-7607e311cec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:28.067515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd0532-c4d2-4c97-94a1-7607e311cec7 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:28.078383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 693/1379] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:30.390909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafe67-2c01-453a-978d-b09e62d59155 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:30.391467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafe67-2c01-453a-978d-b09e62d59155 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:30.391689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafe67-2c01-453a-978d-b09e62d59155 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:30.393171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 687/1380] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:30.398970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cca3d-9b27-4e2b-b1a2-c7bc1672151c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:30.399444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cca3d-9b27-4e2b-b1a2-c7bc1672151c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:30.399716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cca3d-9b27-4e2b-b1a2-c7bc1672151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:30.419119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9f2cca3d-9b27-4e2b-b1a2-c7bc1672151c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:30.420495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9f2cca3d-9b27-4e2b-b1a2-c7bc1672151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:30.429505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 694/1381] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:30.479211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbafe67-2c01-453a-978d-b09e62d59155 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:30.499031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbafe67-2c01-453a-978d-b09e62d59155 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:30.506185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ae36a-c06f-41d1-a996-bcda2b800099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:30.507040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae36a-c06f-41d1-a996-bcda2b800099 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:30.507634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae36a-c06f-41d1-a996-bcda2b800099 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:30.508061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae36a-c06f-41d1-a996-bcda2b800099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:30.518366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ae36a-c06f-41d1-a996-bcda2b800099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:30.520880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ae36a-c06f-41d1-a996-bcda2b800099 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:30.534168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 688/1382] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:32.899906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f258f6-157c-4189-b2cd-5eb7e3ea27da None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:32.900499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f258f6-157c-4189-b2cd-5eb7e3ea27da None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:32.900499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f258f6-157c-4189-b2cd-5eb7e3ea27da None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:32.902099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 695/1383] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:32.907292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13130d-2ee0-485c-8166-bfbdb844b697 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:32.907770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13130d-2ee0-485c-8166-bfbdb844b697 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:32.907882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13130d-2ee0-485c-8166-bfbdb844b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:32.926544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5a13130d-2ee0-485c-8166-bfbdb844b697 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:32.927855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5a13130d-2ee0-485c-8166-bfbdb844b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:32.936317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 689/1384] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:32.983480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f258f6-157c-4189-b2cd-5eb7e3ea27da None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:33.003979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f258f6-157c-4189-b2cd-5eb7e3ea27da None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:33.009782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c3ef-d613-464e-b212-2f745827fb28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:33.010488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c3ef-d613-464e-b212-2f745827fb28 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:33.010769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c3ef-d613-464e-b212-2f745827fb28 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:33.011038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c3ef-d613-464e-b212-2f745827fb28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:33.020789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c3ef-d613-464e-b212-2f745827fb28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:33.022412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c3ef-d613-464e-b212-2f745827fb28 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:33.033338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 696/1385] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:35.518408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ca743-0da0-45b2-a277-d5d42d88ed9e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:35.519013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ca743-0da0-45b2-a277-d5d42d88ed9e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:35.519013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ca743-0da0-45b2-a277-d5d42d88ed9e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:35.520360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 690/1386] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:35.526752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e01ad-cabf-41a0-8fd5-e468ba2369c9 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:35.527174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e01ad-cabf-41a0-8fd5-e468ba2369c9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:35.527499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e01ad-cabf-41a0-8fd5-e468ba2369c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:35.546932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-489e01ad-cabf-41a0-8fd5-e468ba2369c9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:35.548194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-489e01ad-cabf-41a0-8fd5-e468ba2369c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:35.555919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 697/1387] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:35.601634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ca743-0da0-45b2-a277-d5d42d88ed9e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:35.618371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ca743-0da0-45b2-a277-d5d42d88ed9e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:35.624290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1d14-5e86-441a-9213-a0de1985810d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:35.624973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1d14-5e86-441a-9213-a0de1985810d service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:35.625315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1d14-5e86-441a-9213-a0de1985810d service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:35.625524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1d14-5e86-441a-9213-a0de1985810d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:35.637525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1d14-5e86-441a-9213-a0de1985810d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:35.640258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1d14-5e86-441a-9213-a0de1985810d service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:35.653327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 691/1388] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:38.016383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab211b-c01a-4453-8204-47dc83245e36 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:38.016951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab211b-c01a-4453-8204-47dc83245e36 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:38.016951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab211b-c01a-4453-8204-47dc83245e36 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:38.018327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 698/1389] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:38.025238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ded66-0a7b-4018-82c0-addb049ed511 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:38.025706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ded66-0a7b-4018-82c0-addb049ed511 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:38.026061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ded66-0a7b-4018-82c0-addb049ed511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:38.045302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-df1ded66-0a7b-4018-82c0-addb049ed511 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:38.046707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-df1ded66-0a7b-4018-82c0-addb049ed511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:38.054552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 692/1390] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:38.109203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab211b-c01a-4453-8204-47dc83245e36 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:38.124415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab211b-c01a-4453-8204-47dc83245e36 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:38.130329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab646a-ad7f-42e8-a827-a5c4d6d37b98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:38.130994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab646a-ad7f-42e8-a827-a5c4d6d37b98 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:38.131427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab646a-ad7f-42e8-a827-a5c4d6d37b98 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:38.131713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab646a-ad7f-42e8-a827-a5c4d6d37b98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:38.141379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab646a-ad7f-42e8-a827-a5c4d6d37b98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:38.143052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab646a-ad7f-42e8-a827-a5c4d6d37b98 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:38.152926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 699/1391] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:40.574408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8813e-4a75-45e8-a8ab-54f4f5d5e07e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:40.575364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8813e-4a75-45e8-a8ab-54f4f5d5e07e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:40.575662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8813e-4a75-45e8-a8ab-54f4f5d5e07e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:40.577257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 693/1392] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:40.583469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8751b-ece8-4599-9d27-2dd83b5e1b98 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:40.583939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8751b-ece8-4599-9d27-2dd83b5e1b98 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:40.584154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8751b-ece8-4599-9d27-2dd83b5e1b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:40.601861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-90d8751b-ece8-4599-9d27-2dd83b5e1b98 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:40.603052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-90d8751b-ece8-4599-9d27-2dd83b5e1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:40.611509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 700/1393] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:40.656708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8813e-4a75-45e8-a8ab-54f4f5d5e07e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:40.671618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8813e-4a75-45e8-a8ab-54f4f5d5e07e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:40.677144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d22e-5cd9-42d9-8881-77fb0a2f78e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:40.677784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d22e-5cd9-42d9-8881-77fb0a2f78e3 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:40.678094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d22e-5cd9-42d9-8881-77fb0a2f78e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:40.678370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d22e-5cd9-42d9-8881-77fb0a2f78e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:40.687408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d22e-5cd9-42d9-8881-77fb0a2f78e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:40.689149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d22e-5cd9-42d9-8881-77fb0a2f78e3 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:40.698999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 694/1394] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:42.229116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80b08-e226-4915-a2e6-19dc903025af None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.229705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80b08-e226-4915-a2e6-19dc903025af None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.229705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80b08-e226-4915-a2e6-19dc903025af None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.231053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 701/1395] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:42.236913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434499e-c4ee-40de-b52e-1c7803b30ba7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.237358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434499e-c4ee-40de-b52e-1c7803b30ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.237462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434499e-c4ee-40de-b52e-1c7803b30ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.256857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5434499e-c4ee-40de-b52e-1c7803b30ba7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:42.258079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5434499e-c4ee-40de-b52e-1c7803b30ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:42.266251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 695/1396] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:42.322791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0825-f989-4796-8289-dd5414d63d0a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.323115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0825-f989-4796-8289-dd5414d63d0a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.323405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0825-f989-4796-8289-dd5414d63d0a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.324744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 702/1397] 10.222.0.84 () {54 vars in 962 bytes} [Fri May 13 18:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:42.329915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf185-8664-4d06-9226-302630c31ab4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.330261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf185-8664-4d06-9226-302630c31ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.330517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bf185-8664-4d06-9226-302630c31ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.379883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b57bf185-8664-4d06-9226-302630c31ab4 None None] MFA Rules not processed for user `7bd83f55b1a84d1894d19a505bcc18c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:42.381080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b57bf185-8664-4d06-9226-302630c31ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:42.440966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 696/1398] 10.222.0.84 () {58 vars in 1059 bytes} [Fri May 13 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:42.448411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0825-f989-4796-8289-dd5414d63d0a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:42.462185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0825-f989-4796-8289-dd5414d63d0a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:42.465860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268883b-1374-41d2-bc4f-f3cab78dc2eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:42.466512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268883b-1374-41d2-bc4f-f3cab78dc2eb service glance] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.466948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268883b-1374-41d2-bc4f-f3cab78dc2eb service glance] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.467229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268883b-1374-41d2-bc4f-f3cab78dc2eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.480022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268883b-1374-41d2-bc4f-f3cab78dc2eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:42.481404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268883b-1374-41d2-bc4f-f3cab78dc2eb service glance] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:42.492652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 703/1399] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:42.920985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c862d-e3de-4b0e-9a80-7af3d18889e6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.921647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c862d-e3de-4b0e-9a80-7af3d18889e6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.921970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c862d-e3de-4b0e-9a80-7af3d18889e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.973761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-264c862d-e3de-4b0e-9a80-7af3d18889e6 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:42.975281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-264c862d-e3de-4b0e-9a80-7af3d18889e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:42.978008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c19ed-ee48-4d6e-85e2-707c1c9db315 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.978492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c19ed-ee48-4d6e-85e2-707c1c9db315 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.978775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c19ed-ee48-4d6e-85e2-707c1c9db315 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:42.980122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 704/1400] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:19:42.987145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:42.987606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:42.988313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:43.007508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:43.009014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:43.017362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 705/1401] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:43.045833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 697/1402] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:43.061258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:43.074651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168932b0-59ea-438e-8377-de8b45fab6dc None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:43.081456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:43.082245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:43.082632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:43.082971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:43.091758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349dde-b307-4e9d-bfb2-f0495b710499 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:43.091968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:43.092142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349dde-b307-4e9d-bfb2-f0495b710499 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:43.093416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349dde-b307-4e9d-bfb2-f0495b710499 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:43.094864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 698/1403] 10.222.0.84 () {54 vars in 942 bytes} [Fri May 13 18:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:43.095024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:43.101389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b92f-d984-4e91-badc-6cdc81ce1fc0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:43.101686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b92f-d984-4e91-badc-6cdc81ce1fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:43.101997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b92f-d984-4e91-badc-6cdc81ce1fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:43.105130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 706/1404] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:19:43.155684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-afd8b92f-d984-4e91-badc-6cdc81ce1fc0 None None] MFA Rules not processed for user `3e8d13580356499dafd5a8eaa7b14d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:43.157097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-afd8b92f-d984-4e91-badc-6cdc81ce1fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:43.237289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 699/1405] 10.222.0.84 () {58 vars in 1039 bytes} [Fri May 13 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:19:43.248099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:43.260087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51509ec-144d-4895-983d-05cff6c0f886 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:43.266279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcac9a-a717-4a8e-9fdf-c1a9436bd869 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:43.267068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcac9a-a717-4a8e-9fdf-c1a9436bd869 service swift] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:43.267421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcac9a-a717-4a8e-9fdf-c1a9436bd869 service swift] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:43.267782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcac9a-a717-4a8e-9fdf-c1a9436bd869 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:43.276800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcac9a-a717-4a8e-9fdf-c1a9436bd869 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:43.278538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcac9a-a717-4a8e-9fdf-c1a9436bd869 service swift] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:43.287449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 707/1406] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:19:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:19:45.449650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339087-0fc2-438c-9651-f2f5704f1279 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:45.449650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339087-0fc2-438c-9651-f2f5704f1279 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:45.449650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339087-0fc2-438c-9651-f2f5704f1279 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:45.454199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 700/1407] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:19:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:19:45.455865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd26a-2ce4-4ef5-99e3-a87ca0d74b1a None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:45.456338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd26a-2ce4-4ef5-99e3-a87ca0d74b1a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:45.456423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd26a-2ce4-4ef5-99e3-a87ca0d74b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:45.482154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-bd3cd26a-2ce4-4ef5-99e3-a87ca0d74b1a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:19:45.485215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bd3cd26a-2ce4-4ef5-99e3-a87ca0d74b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:19:45.492417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 708/1408] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:19:45.538556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339087-0fc2-438c-9651-f2f5704f1279 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:19:45.553293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339087-0fc2-438c-9651-f2f5704f1279 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:19:45.558812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac44d1-bb74-40eb-8069-729ed02f4210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:19:45.559449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac44d1-bb74-40eb-8069-729ed02f4210 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:19:45.559787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac44d1-bb74-40eb-8069-729ed02f4210 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:19:45.560043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac44d1-bb74-40eb-8069-729ed02f4210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:19:45.569500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac44d1-bb74-40eb-8069-729ed02f4210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:19:45.571141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac44d1-bb74-40eb-8069-729ed02f4210 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:19:45.581460 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 701/1409] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:06.953993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7498f3c-30f0-4cee-9109-b4745d47c987 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:06.954680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7498f3c-30f0-4cee-9109-b4745d47c987 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:06.954680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7498f3c-30f0-4cee-9109-b4745d47c987 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:06.955919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 709/1410] 10.222.0.84 () {54 vars in 918 bytes} [Fri May 13 18:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:06.963318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfabdd-0dfc-443e-97e2-5c322c061679 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:06.963852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfabdd-0dfc-443e-97e2-5c322c061679 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:06.963852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfabdd-0dfc-443e-97e2-5c322c061679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:06.982213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-81cfabdd-0dfc-443e-97e2-5c322c061679 None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:06.983397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-81cfabdd-0dfc-443e-97e2-5c322c061679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:06.992142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 702/1411] 10.222.0.84 () {58 vars in 1015 bytes} [Fri May 13 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:07.007237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de940d-8bdc-4082-a9b1-83d91924a5e9 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:07.007527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de940d-8bdc-4082-a9b1-83d91924a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:07.007817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de940d-8bdc-4082-a9b1-83d91924a5e9 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:07.009169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 710/1412] 10.222.0.84 () {54 vars in 918 bytes} [Fri May 13 18:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:07.013883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2831af-edcc-4883-b79f-45cb101c8048 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:07.014176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2831af-edcc-4883-b79f-45cb101c8048 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:07.014457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2831af-edcc-4883-b79f-45cb101c8048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:07.033116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7a2831af-edcc-4883-b79f-45cb101c8048 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:07.034321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7a2831af-edcc-4883-b79f-45cb101c8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:07.043301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 703/1413] 10.222.0.84 () {58 vars in 1015 bytes} [Fri May 13 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:20:09.739749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f37456-adfd-4e21-8b2d-9299e0af351d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:09.740293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f37456-adfd-4e21-8b2d-9299e0af351d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:09.740293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f37456-adfd-4e21-8b2d-9299e0af351d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:09.741605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:09.747142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf632e2-8943-465f-83d3-d6dd5b7b8c86 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:09.747557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf632e2-8943-465f-83d3-d6dd5b7b8c86 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:09.747702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf632e2-8943-465f-83d3-d6dd5b7b8c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:09.766406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2cf632e2-8943-465f-83d3-d6dd5b7b8c86 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:09.767588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2cf632e2-8943-465f-83d3-d6dd5b7b8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:09.775707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:09.818051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f37456-adfd-4e21-8b2d-9299e0af351d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:09.832020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f37456-adfd-4e21-8b2d-9299e0af351d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:09.837355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095bb46-a354-4cf5-a14e-5e9b7b87a302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:09.838028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095bb46-a354-4cf5-a14e-5e9b7b87a302 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:09.838309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095bb46-a354-4cf5-a14e-5e9b7b87a302 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:09.838583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095bb46-a354-4cf5-a14e-5e9b7b87a302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:09.846840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095bb46-a354-4cf5-a14e-5e9b7b87a302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:09.848409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095bb46-a354-4cf5-a14e-5e9b7b87a302 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:09.857486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 712/1416] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:10.853066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff97bcb-b3fe-4c2c-939e-eb31405750d8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:10.853649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff97bcb-b3fe-4c2c-939e-eb31405750d8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:10.853649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff97bcb-b3fe-4c2c-939e-eb31405750d8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:10.855081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:10.860237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a94f8-5595-4e67-a965-4877afc56760 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:10.860745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a94f8-5595-4e67-a965-4877afc56760 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:10.860845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a94f8-5595-4e67-a965-4877afc56760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:10.880814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1d2a94f8-5595-4e67-a965-4877afc56760 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:10.882083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1d2a94f8-5595-4e67-a965-4877afc56760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:10.889813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:11.046068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff97bcb-b3fe-4c2c-939e-eb31405750d8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:11.060591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff97bcb-b3fe-4c2c-939e-eb31405750d8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:11.066061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3b681-9002-4a8a-add0-f53f781e8963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:11.066683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3b681-9002-4a8a-add0-f53f781e8963 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:11.066960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3b681-9002-4a8a-add0-f53f781e8963 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:11.067230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3b681-9002-4a8a-add0-f53f781e8963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:11.075375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3b681-9002-4a8a-add0-f53f781e8963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:11.076950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3b681-9002-4a8a-add0-f53f781e8963 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:11.086457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 706/1419] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:12.040075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376ae1-f22e-4f82-adf4-e0afe761fdd1 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:12.040667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376ae1-f22e-4f82-adf4-e0afe761fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:12.040667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376ae1-f22e-4f82-adf4-e0afe761fdd1 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:12.042053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:12.047734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693de4e6-4938-41eb-a8ed-3fe130dcf261 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:12.048192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693de4e6-4938-41eb-a8ed-3fe130dcf261 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:12.048298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693de4e6-4938-41eb-a8ed-3fe130dcf261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:12.067175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-693de4e6-4938-41eb-a8ed-3fe130dcf261 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:12.068357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-693de4e6-4938-41eb-a8ed-3fe130dcf261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:12.076661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:12.223793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6376ae1-f22e-4f82-adf4-e0afe761fdd1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:12.239036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6376ae1-f22e-4f82-adf4-e0afe761fdd1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:12.244377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e076f-e409-4dc7-ae56-867fbf69dcc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:12.244988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e076f-e409-4dc7-ae56-867fbf69dcc4 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:12.245272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e076f-e409-4dc7-ae56-867fbf69dcc4 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:12.245549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e076f-e409-4dc7-ae56-867fbf69dcc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:12.254308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e076f-e409-4dc7-ae56-867fbf69dcc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:12.255879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e076f-e409-4dc7-ae56-867fbf69dcc4 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:12.265088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 715/1422] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:13.190234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe60d08-d421-47b2-b87f-3a3ab9f183e9 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:13.190813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe60d08-d421-47b2-b87f-3a3ab9f183e9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:13.190813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe60d08-d421-47b2-b87f-3a3ab9f183e9 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:13.192131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:13.197172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a81f-622a-4bef-a9f9-c2efd59b5744 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:13.197591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a81f-622a-4bef-a9f9-c2efd59b5744 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:13.197724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a81f-622a-4bef-a9f9-c2efd59b5744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:13.216239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ff47a81f-622a-4bef-a9f9-c2efd59b5744 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:13.217371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ff47a81f-622a-4bef-a9f9-c2efd59b5744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:13.225524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:13.376061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe60d08-d421-47b2-b87f-3a3ab9f183e9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:13.390710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe60d08-d421-47b2-b87f-3a3ab9f183e9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:13.396035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d153fc-0ef6-42b7-bd86-f0861ab019af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:13.396661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d153fc-0ef6-42b7-bd86-f0861ab019af service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:13.396943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d153fc-0ef6-42b7-bd86-f0861ab019af service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:13.397218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d153fc-0ef6-42b7-bd86-f0861ab019af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:13.405173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d153fc-0ef6-42b7-bd86-f0861ab019af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:13.407733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d153fc-0ef6-42b7-bd86-f0861ab019af service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:13.417048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 709/1425] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:14.345971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350494ee-430f-4d94-bcbe-20807d4a4185 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:14.346520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350494ee-430f-4d94-bcbe-20807d4a4185 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:14.346520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350494ee-430f-4d94-bcbe-20807d4a4185 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:14.347887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:14.352844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87227-37da-46e0-a38b-c1daaa29d2df None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:14.353278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87227-37da-46e0-a38b-c1daaa29d2df None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:14.353403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87227-37da-46e0-a38b-c1daaa29d2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:14.371749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fbe87227-37da-46e0-a38b-c1daaa29d2df None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:14.372926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fbe87227-37da-46e0-a38b-c1daaa29d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:14.381278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:14.532604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350494ee-430f-4d94-bcbe-20807d4a4185 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:14.547041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350494ee-430f-4d94-bcbe-20807d4a4185 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:14.552340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d484ff2-9591-4f60-b258-3ae57b8c3eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:14.552969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d484ff2-9591-4f60-b258-3ae57b8c3eb1 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:14.553249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d484ff2-9591-4f60-b258-3ae57b8c3eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:14.553523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d484ff2-9591-4f60-b258-3ae57b8c3eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:14.561441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d484ff2-9591-4f60-b258-3ae57b8c3eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:14.563066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d484ff2-9591-4f60-b258-3ae57b8c3eb1 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:14.572196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 718/1428] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:20:15.461040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a5b2c-832a-463b-999a-8fdd860a0b8e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:15.461607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a5b2c-832a-463b-999a-8fdd860a0b8e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:15.461607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a5b2c-832a-463b-999a-8fdd860a0b8e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:15.463033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:15.468723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e690-3bcc-474c-b0f2-6e3d234df895 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:15.469181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e690-3bcc-474c-b0f2-6e3d234df895 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:15.469337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e690-3bcc-474c-b0f2-6e3d234df895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:15.487633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b875e690-3bcc-474c-b0f2-6e3d234df895 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:15.489059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b875e690-3bcc-474c-b0f2-6e3d234df895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:15.496843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:15.650522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a5b2c-832a-463b-999a-8fdd860a0b8e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:15.665822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a5b2c-832a-463b-999a-8fdd860a0b8e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:15.671086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b946a-b0df-495c-ae72-d91dc7e30184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:15.671877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b946a-b0df-495c-ae72-d91dc7e30184 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:15.672150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b946a-b0df-495c-ae72-d91dc7e30184 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:15.672419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b946a-b0df-495c-ae72-d91dc7e30184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:15.680547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b946a-b0df-495c-ae72-d91dc7e30184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:15.682141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b946a-b0df-495c-ae72-d91dc7e30184 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:15.691361 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 712/1431] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:16.565497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d45-04ad-49db-b699-605d654aef0c None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:16.566099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d45-04ad-49db-b699-605d654aef0c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:16.566099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d45-04ad-49db-b699-605d654aef0c None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:16.567649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:16.572621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c127e-64a5-40a3-bb8a-4a0075980531 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:16.573078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c127e-64a5-40a3-bb8a-4a0075980531 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:16.573180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c127e-64a5-40a3-bb8a-4a0075980531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:16.591525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-795c127e-64a5-40a3-bb8a-4a0075980531 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:16.592717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-795c127e-64a5-40a3-bb8a-4a0075980531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:16.601417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:20:16.751031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d45-04ad-49db-b699-605d654aef0c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:16.764843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d45-04ad-49db-b699-605d654aef0c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:16.771211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0f445-d9c3-4c65-8b89-4c5789053528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:16.771863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f445-d9c3-4c65-8b89-4c5789053528 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:16.772147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f445-d9c3-4c65-8b89-4c5789053528 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:16.772426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0f445-d9c3-4c65-8b89-4c5789053528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:16.781141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0f445-d9c3-4c65-8b89-4c5789053528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:16.782911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0f445-d9c3-4c65-8b89-4c5789053528 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:16.792635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 721/1434] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:17.666230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b08928-bc15-436b-98a0-3fc80d0dc599 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:17.666802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b08928-bc15-436b-98a0-3fc80d0dc599 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:17.666802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b08928-bc15-436b-98a0-3fc80d0dc599 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:17.668186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:17.674183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d211-e0bf-4bb8-92e5-902c30698c1a None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:17.674628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d211-e0bf-4bb8-92e5-902c30698c1a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:17.674772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d211-e0bf-4bb8-92e5-902c30698c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:17.692377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3dd9d211-e0bf-4bb8-92e5-902c30698c1a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:17.693562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3dd9d211-e0bf-4bb8-92e5-902c30698c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:17.701280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:17.855006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b08928-bc15-436b-98a0-3fc80d0dc599 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:17.870142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b08928-bc15-436b-98a0-3fc80d0dc599 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:17.875601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35657abf-f8c4-4548-8e18-f8855c84d71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:17.876236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657abf-f8c4-4548-8e18-f8855c84d71c service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:17.876519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657abf-f8c4-4548-8e18-f8855c84d71c service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:17.876792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657abf-f8c4-4548-8e18-f8855c84d71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:17.885106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35657abf-f8c4-4548-8e18-f8855c84d71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:17.886701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35657abf-f8c4-4548-8e18-f8855c84d71c service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:17.896418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 715/1437] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:18.783490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2336b9-dc1b-4f10-9abf-46b2759503b5 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:18.784021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2336b9-dc1b-4f10-9abf-46b2759503b5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:18.784021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2336b9-dc1b-4f10-9abf-46b2759503b5 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:18.785313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:18.790327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33a18-5ceb-4dd0-a023-48e3fff764a2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:18.790826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33a18-5ceb-4dd0-a023-48e3fff764a2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:18.790922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33a18-5ceb-4dd0-a023-48e3fff764a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:18.808437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f8b33a18-5ceb-4dd0-a023-48e3fff764a2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:18.809613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f8b33a18-5ceb-4dd0-a023-48e3fff764a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:18.817623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:20:18.967579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2336b9-dc1b-4f10-9abf-46b2759503b5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:18.982957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2336b9-dc1b-4f10-9abf-46b2759503b5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:18.988431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4128e1a-3ab7-474d-8695-2df6428105fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:18.989333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128e1a-3ab7-474d-8695-2df6428105fb service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:18.989605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128e1a-3ab7-474d-8695-2df6428105fb service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:18.989929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128e1a-3ab7-474d-8695-2df6428105fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:18.998391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4128e1a-3ab7-474d-8695-2df6428105fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:19.000504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4128e1a-3ab7-474d-8695-2df6428105fb service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:19.010647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 724/1440] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:21.128122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1723-202a-40d2-ba28-323f5233ffcb None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:21.128731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1723-202a-40d2-ba28-323f5233ffcb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:21.128731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1723-202a-40d2-ba28-323f5233ffcb None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:21.130082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:21.135402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76c71-023c-4492-b822-2443c6e1efcc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:21.135820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76c71-023c-4492-b822-2443c6e1efcc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:21.135938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76c71-023c-4492-b822-2443c6e1efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:21.154406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-10f76c71-023c-4492-b822-2443c6e1efcc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:21.156769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-10f76c71-023c-4492-b822-2443c6e1efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:21.164565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:20:21.203804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1723-202a-40d2-ba28-323f5233ffcb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:21.205491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9d7f1723-202a-40d2-ba28-323f5233ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:21.218671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1723-202a-40d2-ba28-323f5233ffcb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:21.222270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27df46e-8525-4b09-af74-158955a615f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:21.222898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df46e-8525-4b09-af74-158955a615f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:21.223181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df46e-8525-4b09-af74-158955a615f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:21.223452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df46e-8525-4b09-af74-158955a615f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:21.232201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27df46e-8525-4b09-af74-158955a615f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:21.233644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27df46e-8525-4b09-af74-158955a615f4 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:21.243328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 718/1443] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:23.647216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257de37-0f8a-4f5d-8ef7-4923ae1ee97a None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:23.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257de37-0f8a-4f5d-8ef7-4923ae1ee97a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:23.647761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257de37-0f8a-4f5d-8ef7-4923ae1ee97a None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:23.649115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:23.654767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d603-7633-47ad-8c02-859316acca8a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:23.655241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d603-7633-47ad-8c02-859316acca8a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:23.655339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d603-7633-47ad-8c02-859316acca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:23.674005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8c14d603-7633-47ad-8c02-859316acca8a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:23.675188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8c14d603-7633-47ad-8c02-859316acca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:23.683114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:20:23.720933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257de37-0f8a-4f5d-8ef7-4923ae1ee97a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:23.731304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257de37-0f8a-4f5d-8ef7-4923ae1ee97a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:23.735669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451a57-03e2-42fb-9130-ab861d7abe96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:23.736313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451a57-03e2-42fb-9130-ab861d7abe96 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:23.736592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451a57-03e2-42fb-9130-ab861d7abe96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:23.736868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451a57-03e2-42fb-9130-ab861d7abe96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:23.746023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451a57-03e2-42fb-9130-ab861d7abe96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:23.747447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451a57-03e2-42fb-9130-ab861d7abe96 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:23.756695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 727/1446] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:26.355645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9072be-c6b6-4528-a09e-8418f87fc670 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:26.356313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9072be-c6b6-4528-a09e-8418f87fc670 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:26.356313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9072be-c6b6-4528-a09e-8418f87fc670 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:26.357603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:26.363384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989008-e626-4c5b-9250-9164252f7ebc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:26.363816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989008-e626-4c5b-9250-9164252f7ebc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:26.363950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989008-e626-4c5b-9250-9164252f7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:26.382554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-82989008-e626-4c5b-9250-9164252f7ebc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:26.383739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-82989008-e626-4c5b-9250-9164252f7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:26.392519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:26.430602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9072be-c6b6-4528-a09e-8418f87fc670 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:26.441747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9072be-c6b6-4528-a09e-8418f87fc670 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:26.445382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d7391-086c-4736-83c0-161fe43faa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:26.446037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d7391-086c-4736-83c0-161fe43faa3a service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:26.446319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d7391-086c-4736-83c0-161fe43faa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:26.446592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d7391-086c-4736-83c0-161fe43faa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:26.456126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d7391-086c-4736-83c0-161fe43faa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:26.457557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d7391-086c-4736-83c0-161fe43faa3a service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:26.467165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 721/1449] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:28.847704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834431-9d42-49c3-8f65-e1c4d012b543 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:28.848394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834431-9d42-49c3-8f65-e1c4d012b543 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:28.848394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834431-9d42-49c3-8f65-e1c4d012b543 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:28.849666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:28.855596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b8d2f-1ae4-47db-8587-cec26b779632 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:28.856086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b8d2f-1ae4-47db-8587-cec26b779632 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:28.856193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b8d2f-1ae4-47db-8587-cec26b779632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:28.874972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c32b8d2f-1ae4-47db-8587-cec26b779632 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:28.876191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c32b8d2f-1ae4-47db-8587-cec26b779632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:28.883891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:28.921935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3834431-9d42-49c3-8f65-e1c4d012b543 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:28.932274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3834431-9d42-49c3-8f65-e1c4d012b543 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:28.935673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d242c8f-5700-448c-8dcd-b739fcca3ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:28.936306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242c8f-5700-448c-8dcd-b739fcca3ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:28.936581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242c8f-5700-448c-8dcd-b739fcca3ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:28.937492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242c8f-5700-448c-8dcd-b739fcca3ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:28.946219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d242c8f-5700-448c-8dcd-b739fcca3ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:28.947619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d242c8f-5700-448c-8dcd-b739fcca3ad6 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:28.956771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 730/1452] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:31.251273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e01fb-d120-450b-9836-d63cca758288 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:31.251830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e01fb-d120-450b-9836-d63cca758288 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:31.251830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e01fb-d120-450b-9836-d63cca758288 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:31.253176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:31.258506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6b972-4967-45fa-a981-6d8ccbda908e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:31.258918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6b972-4967-45fa-a981-6d8ccbda908e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:31.259074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6b972-4967-45fa-a981-6d8ccbda908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:31.276787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0eb6b972-4967-45fa-a981-6d8ccbda908e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:31.277999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0eb6b972-4967-45fa-a981-6d8ccbda908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:31.286453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:31.323987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e01fb-d120-450b-9836-d63cca758288 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:31.335436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e01fb-d120-450b-9836-d63cca758288 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:31.338911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3e242-9c18-4131-b124-a52234180b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:31.339546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3e242-9c18-4131-b124-a52234180b0d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:31.339828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3e242-9c18-4131-b124-a52234180b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:31.340104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3e242-9c18-4131-b124-a52234180b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:31.349789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3e242-9c18-4131-b124-a52234180b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:31.351232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3e242-9c18-4131-b124-a52234180b0d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:31.360632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 724/1455] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:33.711892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece2ae-5d31-426f-8665-d76b4ea9a7e6 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:33.712530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece2ae-5d31-426f-8665-d76b4ea9a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:33.712530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece2ae-5d31-426f-8665-d76b4ea9a7e6 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:33.713810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:33.720189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc75dff-f147-44da-820d-e359a04cea53 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:33.720649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc75dff-f147-44da-820d-e359a04cea53 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:33.720756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc75dff-f147-44da-820d-e359a04cea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:33.738441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9bc75dff-f147-44da-820d-e359a04cea53 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:33.739894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9bc75dff-f147-44da-820d-e359a04cea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:33.747549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:33.786545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece2ae-5d31-426f-8665-d76b4ea9a7e6 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:33.796893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece2ae-5d31-426f-8665-d76b4ea9a7e6 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:33.800275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14dae3-1e14-4940-bfd1-1bf620391f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:33.800901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14dae3-1e14-4940-bfd1-1bf620391f2c service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:33.801183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14dae3-1e14-4940-bfd1-1bf620391f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:33.801449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14dae3-1e14-4940-bfd1-1bf620391f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:33.810155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14dae3-1e14-4940-bfd1-1bf620391f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:33.812074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14dae3-1e14-4940-bfd1-1bf620391f2c service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:33.821388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 733/1458] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:36.083290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243518-4822-4556-a29f-add5c6769142 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:36.083885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243518-4822-4556-a29f-add5c6769142 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:36.083885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243518-4822-4556-a29f-add5c6769142 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:36.085188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:36.090460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69bc6a-1171-429b-9397-0fb705b57e3c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:36.090892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69bc6a-1171-429b-9397-0fb705b57e3c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:36.091013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69bc6a-1171-429b-9397-0fb705b57e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:36.111252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aa69bc6a-1171-429b-9397-0fb705b57e3c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:36.112424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aa69bc6a-1171-429b-9397-0fb705b57e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:36.120202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:36.157317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243518-4822-4556-a29f-add5c6769142 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:36.167795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243518-4822-4556-a29f-add5c6769142 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:36.171845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da4e9e-5511-4799-96ee-692e90935148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:36.172629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da4e9e-5511-4799-96ee-692e90935148 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:36.172912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da4e9e-5511-4799-96ee-692e90935148 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:36.173183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da4e9e-5511-4799-96ee-692e90935148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:36.182023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da4e9e-5511-4799-96ee-692e90935148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:36.183440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da4e9e-5511-4799-96ee-692e90935148 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:36.192760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 727/1461] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:38.481765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daaf46-2233-40b4-8134-0dc64b87bf2d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:38.482314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daaf46-2233-40b4-8134-0dc64b87bf2d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:38.482424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daaf46-2233-40b4-8134-0dc64b87bf2d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:38.483722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:38.489065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191200b-3594-448d-ae61-2ea430f5227a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:38.489767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191200b-3594-448d-ae61-2ea430f5227a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:38.489944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191200b-3594-448d-ae61-2ea430f5227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:38.507482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f191200b-3594-448d-ae61-2ea430f5227a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:38.508646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f191200b-3594-448d-ae61-2ea430f5227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:38.517034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:38.554818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daaf46-2233-40b4-8134-0dc64b87bf2d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:38.565987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daaf46-2233-40b4-8134-0dc64b87bf2d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:38.569572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660749f-8e87-47fe-b1d5-ab95883fe229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:38.570241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660749f-8e87-47fe-b1d5-ab95883fe229 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:38.570517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660749f-8e87-47fe-b1d5-ab95883fe229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:38.570804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660749f-8e87-47fe-b1d5-ab95883fe229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:38.580289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660749f-8e87-47fe-b1d5-ab95883fe229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:38.581753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660749f-8e87-47fe-b1d5-ab95883fe229 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:38.590871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 736/1464] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:40.854466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7895-0213-4128-8ca5-bd26eb6d3624 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:40.855043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7895-0213-4128-8ca5-bd26eb6d3624 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:40.855043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7895-0213-4128-8ca5-bd26eb6d3624 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:40.856399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:40.862817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0125a-8ffb-439d-b596-cac06a157f76 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:40.863307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0125a-8ffb-439d-b596-cac06a157f76 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:40.863679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0125a-8ffb-439d-b596-cac06a157f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:40.882473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fcb0125a-8ffb-439d-b596-cac06a157f76 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:40.883655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fcb0125a-8ffb-439d-b596-cac06a157f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:40.891449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:40.927525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7895-0213-4128-8ca5-bd26eb6d3624 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:40.938917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7895-0213-4128-8ca5-bd26eb6d3624 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:40.942405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c487-298a-4ca1-b283-1a88e1bd17d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:40.943032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c487-298a-4ca1-b283-1a88e1bd17d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:40.943312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c487-298a-4ca1-b283-1a88e1bd17d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:40.943592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c487-298a-4ca1-b283-1a88e1bd17d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:40.952293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c487-298a-4ca1-b283-1a88e1bd17d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:40.953781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c487-298a-4ca1-b283-1a88e1bd17d8 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:40.963033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 730/1467] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:20:43.190718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0c1e-c0f9-46e4-8da4-9c8ccaa68ec9 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:43.191400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0c1e-c0f9-46e4-8da4-9c8ccaa68ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:43.191400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0c1e-c0f9-46e4-8da4-9c8ccaa68ec9 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:43.192613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:20:43.197893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587b7e-69e4-4a8d-a182-514986d5e1e5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:43.198350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587b7e-69e4-4a8d-a182-514986d5e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:43.198450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587b7e-69e4-4a8d-a182-514986d5e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:43.216801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-46587b7e-69e4-4a8d-a182-514986d5e1e5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:20:43.218057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-46587b7e-69e4-4a8d-a182-514986d5e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:20:43.227246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:20:43.263058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d0c1e-c0f9-46e4-8da4-9c8ccaa68ec9 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:20:43.274188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d0c1e-c0f9-46e4-8da4-9c8ccaa68ec9 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:20:43.277650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989acda-0e32-4929-980f-c20ab929e014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:20:43.278324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989acda-0e32-4929-980f-c20ab929e014 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:20:43.278609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989acda-0e32-4929-980f-c20ab929e014 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:20:43.278885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989acda-0e32-4929-980f-c20ab929e014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:20:43.288207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989acda-0e32-4929-980f-c20ab929e014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:20:43.289616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989acda-0e32-4929-980f-c20ab929e014 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:20:43.298923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 739/1470] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:21:16.750443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773c6c6-33ed-41f7-bb3f-d8eadf2a7af0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:16.751022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773c6c6-33ed-41f7-bb3f-d8eadf2a7af0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:16.751022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773c6c6-33ed-41f7-bb3f-d8eadf2a7af0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:16.752284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 732/1471] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:16.757560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034d556-4a82-4718-87d4-f40dd4950cbe None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:16.758001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034d556-4a82-4718-87d4-f40dd4950cbe None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:16.758153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034d556-4a82-4718-87d4-f40dd4950cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:16.776083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7034d556-4a82-4718-87d4-f40dd4950cbe None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:16.777268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7034d556-4a82-4718-87d4-f40dd4950cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:16.785874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 740/1472] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:16.834760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591391-4d2f-4f1f-8d11-ef003bd4f977 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:16.835042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591391-4d2f-4f1f-8d11-ef003bd4f977 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:16.835315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591391-4d2f-4f1f-8d11-ef003bd4f977 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:16.836682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 733/1473] 10.222.0.84 () {54 vars in 962 bytes} [Fri May 13 18:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:16.841597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390faa37-c6b6-430f-a4f8-ae75ae0de556 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:16.841931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390faa37-c6b6-430f-a4f8-ae75ae0de556 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:16.842269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390faa37-c6b6-430f-a4f8-ae75ae0de556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:16.861514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-390faa37-c6b6-430f-a4f8-ae75ae0de556 None None] MFA Rules not processed for user `7bd83f55b1a84d1894d19a505bcc18c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:16.862783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-390faa37-c6b6-430f-a4f8-ae75ae0de556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:16.869461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 741/1474] 10.222.0.84 () {58 vars in 1059 bytes} [Fri May 13 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:16.877471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591391-4d2f-4f1f-8d11-ef003bd4f977 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:16.887680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591391-4d2f-4f1f-8d11-ef003bd4f977 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:16.891314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329d4c5-0351-492e-903e-9663ebe8df56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:16.891930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329d4c5-0351-492e-903e-9663ebe8df56 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:16.892207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329d4c5-0351-492e-903e-9663ebe8df56 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:16.892478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329d4c5-0351-492e-903e-9663ebe8df56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:16.901231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329d4c5-0351-492e-903e-9663ebe8df56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:16.902670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329d4c5-0351-492e-903e-9663ebe8df56 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:16.911727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 734/1475] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:21:19.264669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392db3f3-4449-4354-9b05-4fd6fbe7ffcf None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:19.265235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392db3f3-4449-4354-9b05-4fd6fbe7ffcf None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:19.265235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392db3f3-4449-4354-9b05-4fd6fbe7ffcf None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:19.266656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 742/1476] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:19.272350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a75a-20cd-4634-b977-dcf5f1afffe7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:19.272794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a75a-20cd-4634-b977-dcf5f1afffe7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:19.272910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a75a-20cd-4634-b977-dcf5f1afffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:19.290612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8bd2a75a-20cd-4634-b977-dcf5f1afffe7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:19.291817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8bd2a75a-20cd-4634-b977-dcf5f1afffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:19.299613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 735/1477] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:19.323031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392db3f3-4449-4354-9b05-4fd6fbe7ffcf None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:19.337436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392db3f3-4449-4354-9b05-4fd6fbe7ffcf None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:19.341779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:19.343094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:19.343370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:19.343638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:19.344366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:19.346132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:21:19.346132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:21:19.346132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:21:19.347247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5d336-2ad6-44a2-a987-5e3f1117100e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:19.366298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 743/1478] 10.222.0.84 () {56 vars in 1108 bytes} [Fri May 13 18:21:19 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:21:21.669610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f916-ef17-46f5-b002-218921f7dc0e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:21.670743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f916-ef17-46f5-b002-218921f7dc0e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:21.670743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f916-ef17-46f5-b002-218921f7dc0e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:21.672487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 736/1479] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:21:21.677926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e9493-7a5b-437b-a501-eb8cfe9b36f3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:21.678413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e9493-7a5b-437b-a501-eb8cfe9b36f3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:21.678529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e9493-7a5b-437b-a501-eb8cfe9b36f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:21.698283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-676e9493-7a5b-437b-a501-eb8cfe9b36f3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:21.699486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-676e9493-7a5b-437b-a501-eb8cfe9b36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:21.707685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 744/1480] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:21.751786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f916-ef17-46f5-b002-218921f7dc0e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:21.766037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f916-ef17-46f5-b002-218921f7dc0e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:21.784036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33affe4a-749e-4bb0-8fd5-8e2a3e68c3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:21.784686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe4a-749e-4bb0-8fd5-8e2a3e68c3e8 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:21.784968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe4a-749e-4bb0-8fd5-8e2a3e68c3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:21.785242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe4a-749e-4bb0-8fd5-8e2a3e68c3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:21.793978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affe4a-749e-4bb0-8fd5-8e2a3e68c3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:21.796342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affe4a-749e-4bb0-8fd5-8e2a3e68c3e8 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:21.805908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 737/1481] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:21:24.274157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61ea7-fd91-4150-8233-729e4077b6f3 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:24.274736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61ea7-fd91-4150-8233-729e4077b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:24.274736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61ea7-fd91-4150-8233-729e4077b6f3 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:24.276098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 745/1482] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:24.281817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8363e1-c82d-4867-820c-87b23ec26d3a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:24.282244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8363e1-c82d-4867-820c-87b23ec26d3a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:24.282398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8363e1-c82d-4867-820c-87b23ec26d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:24.300510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8a8363e1-c82d-4867-820c-87b23ec26d3a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:24.301702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8a8363e1-c82d-4867-820c-87b23ec26d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:24.309484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 738/1483] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:24.347026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61ea7-fd91-4150-8233-729e4077b6f3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:24.357484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61ea7-fd91-4150-8233-729e4077b6f3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:24.361703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee2b9d-457f-489b-9b0e-b7f3a01b1253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:24.362382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2b9d-457f-489b-9b0e-b7f3a01b1253 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:24.362669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2b9d-457f-489b-9b0e-b7f3a01b1253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:24.362948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2b9d-457f-489b-9b0e-b7f3a01b1253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:24.377507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee2b9d-457f-489b-9b0e-b7f3a01b1253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:24.378994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee2b9d-457f-489b-9b0e-b7f3a01b1253 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:24.388810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 746/1484] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:21:26.747680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ebf7-9354-4706-b76d-23dce03eed39 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:26.748709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ebf7-9354-4706-b76d-23dce03eed39 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:26.748709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ebf7-9354-4706-b76d-23dce03eed39 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:26.750249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 739/1485] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:26.755736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1bf70-0bbc-4a11-aa7c-f97d24c4c254 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:26.756194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1bf70-0bbc-4a11-aa7c-f97d24c4c254 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:26.756293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1bf70-0bbc-4a11-aa7c-f97d24c4c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:26.782559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-09f1bf70-0bbc-4a11-aa7c-f97d24c4c254 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:26.783760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-09f1bf70-0bbc-4a11-aa7c-f97d24c4c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:26.791677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 747/1486] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:26.837640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126ebf7-9354-4706-b76d-23dce03eed39 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:26.848870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126ebf7-9354-4706-b76d-23dce03eed39 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:26.852419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4b43d-f13c-459d-8ba1-9de89aedca21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:26.853085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b43d-f13c-459d-8ba1-9de89aedca21 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:26.853367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b43d-f13c-459d-8ba1-9de89aedca21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:26.853643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b43d-f13c-459d-8ba1-9de89aedca21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:26.863162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4b43d-f13c-459d-8ba1-9de89aedca21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:26.864602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4b43d-f13c-459d-8ba1-9de89aedca21 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:26.875197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 740/1487] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:21:29.251330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757ca62-1ed2-4ace-8323-ebf6b7c9b9b8 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:29.251971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757ca62-1ed2-4ace-8323-ebf6b7c9b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:29.251971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757ca62-1ed2-4ace-8323-ebf6b7c9b9b8 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:29.253273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 748/1488] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:29.258653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836237b-826c-4da3-bedc-aa721385d577 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:29.259076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836237b-826c-4da3-bedc-aa721385d577 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:29.259191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836237b-826c-4da3-bedc-aa721385d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:29.276849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f836237b-826c-4da3-bedc-aa721385d577 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:29.278049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f836237b-826c-4da3-bedc-aa721385d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:29.286182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 741/1489] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:29.326223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757ca62-1ed2-4ace-8323-ebf6b7c9b9b8 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:29.338765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757ca62-1ed2-4ace-8323-ebf6b7c9b9b8 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:29.344773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc2bc-cb5c-4e09-96d7-8cc6de061c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:29.345414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc2bc-cb5c-4e09-96d7-8cc6de061c11 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:29.345685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc2bc-cb5c-4e09-96d7-8cc6de061c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:29.345980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc2bc-cb5c-4e09-96d7-8cc6de061c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:29.354854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afc2bc-cb5c-4e09-96d7-8cc6de061c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:29.356267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afc2bc-cb5c-4e09-96d7-8cc6de061c11 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:29.366013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 749/1490] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:21:31.797633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dab83b-1357-473b-be59-a524f67887d2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:31.798218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dab83b-1357-473b-be59-a524f67887d2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:31.798218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dab83b-1357-473b-be59-a524f67887d2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:31.799554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 742/1491] 10.222.0.84 () {54 vars in 926 bytes} [Fri May 13 18:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:21:31.805085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca41b-e133-4517-b927-2b6126aab8f6 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:31.805670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca41b-e133-4517-b927-2b6126aab8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:31.805670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca41b-e133-4517-b927-2b6126aab8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:31.824609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-369ca41b-e133-4517-b927-2b6126aab8f6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:21:31.825833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-369ca41b-e133-4517-b927-2b6126aab8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:21:31.834070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 750/1492] 10.222.0.84 () {58 vars in 1023 bytes} [Fri May 13 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:21:31.875362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dab83b-1357-473b-be59-a524f67887d2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:21:31.885964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dab83b-1357-473b-be59-a524f67887d2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:21:31.889501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a56a67-17c9-4976-af1a-002c542f3df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:21:31.890509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a56a67-17c9-4976-af1a-002c542f3df1 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:21:31.890796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a56a67-17c9-4976-af1a-002c542f3df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:21:31.891073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a56a67-17c9-4976-af1a-002c542f3df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:21:31.899856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a56a67-17c9-4976-af1a-002c542f3df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:21:31.901269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a56a67-17c9-4976-af1a-002c542f3df1 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:21:31.911364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 743/1493] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:23:10.990681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:10.991578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:10.991578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.010757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:23:11.012633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:11.020447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 751/1494] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:23:11.029933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.030440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.030546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.047944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:23:11.049111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:11.056734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 744/1495] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:23:11.062030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.071374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed361f11-0c67-49d8-bb73-33755de3ac85 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.076622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.077263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.077544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.077847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.078586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:23:11.078890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.079896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.079896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:23:11.079896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:23:11.080767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.092314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 752/1496] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:23:11.100514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.109599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a10653-bbba-4b52-bdd3-60ef45fc81b2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.114369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.115012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.115293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.115568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.116261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.118323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.118323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:23:11.118323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:23:11.119513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.154407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 745/1497] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:23:11.158758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.169108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e06e9-147a-496e-93d2-3be772b19ade admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.223031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.223699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.224041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.224360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.225040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.226090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.226090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:23:11.226090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:23:11.227290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.247812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 753/1498] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:23:11 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:23:11.252005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.262667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f83c-aaca-4ab7-b652-10767aed2742 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.267181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.267826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.268105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.268374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.269097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.270135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.270135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:23:11.270135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:23:11.270992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.283848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 746/1499] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:23:11.287990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.297854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04888f09-fc85-4675-ab8f-34f8c38a6db4 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.302317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.302984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.303267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.303543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.304268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.305274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.305274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:23:11.305274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:23:11.306188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8319-dee2-4a7d-b6af-c5855d9a7b7c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.320011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 754/1500] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:23:11.324157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.334797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74224b7-2c2c-43d3-8de7-7988d8eee800 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.339347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.340884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.341144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.341416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] PATH_INFO: `/v3/projects/52a0e4a5251d48178e6bf6967928600e/users/aa36b0f556e140d5bdb5cb107c1987c9/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.356112 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a0e4a5251d48178e6bf6967928600e, user_id=aa36b0f556e140d5bdb5cb107c1987c9, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.357002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.357002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:23:11.357002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:23:11.358934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4f153-8db0-482c-bedd-0538667d436a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.372423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 747/1501] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:23:11 2022] PUT /identity/v3/projects/52a0e4a5251d48178e6bf6967928600e/users/aa36b0f556e140d5bdb5cb107c1987c9/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:23:11.383557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de344d1f-4187-434a-8c70-a30ea9e77b41 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.383849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de344d1f-4187-434a-8c70-a30ea9e77b41 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.384139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de344d1f-4187-434a-8c70-a30ea9e77b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.410546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-de344d1f-4187-434a-8c70-a30ea9e77b41 None None] MFA Rules not processed for user `aa36b0f556e140d5bdb5cb107c1987c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:23:11.411771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-de344d1f-4187-434a-8c70-a30ea9e77b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:11.476786 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 755/1502] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:23:11.491094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fdbaf-8306-4cb1-bb10-f13d03935d00 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.491652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fdbaf-8306-4cb1-bb10-f13d03935d00 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.491930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fdbaf-8306-4cb1-bb10-f13d03935d00 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.493285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 748/1503] 10.222.0.84 () {54 vars in 963 bytes} [Fri May 13 18:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:23:11.499120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36308b-56d1-4eef-9ea1-e4c09ac57e29 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.499355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36308b-56d1-4eef-9ea1-e4c09ac57e29 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.499635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36308b-56d1-4eef-9ea1-e4c09ac57e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.517257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9e36308b-56d1-4eef-9ea1-e4c09ac57e29 None None] MFA Rules not processed for user `a50eb00b59c3432bb7c085d3d8287ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:23:11.518468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9e36308b-56d1-4eef-9ea1-e4c09ac57e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:11.567023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 756/1504] 10.222.0.84 () {58 vars in 1060 bytes} [Fri May 13 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:23:11.574977 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fdbaf-8306-4cb1-bb10-f13d03935d00 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.586846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fdbaf-8306-4cb1-bb10-f13d03935d00 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.590876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.591497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.591778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.592050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.600358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.601782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.610383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 749/1505] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:23:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:23:11.652767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209809-2c9c-4b1b-a795-ab6aee2a5a41 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.653052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209809-2c9c-4b1b-a795-ab6aee2a5a41 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.653330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209809-2c9c-4b1b-a795-ab6aee2a5a41 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.654666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 757/1506] 10.222.0.84 () {52 vars in 829 bytes} [Fri May 13 18:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:23:11.658290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.719815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae2d9-349b-4b45-b4bb-6d431c054082 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.724280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.725140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.725413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.725683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] PATH_INFO: `/v3/users/aa36b0f556e140d5bdb5cb107c1987c9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.726945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa36b0f556e140d5bdb5cb107c1987c9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:11.727956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:11.727956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:23:11.727956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:23:11.729133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:11.792082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa36b0f556e140d5bdb5cb107c1987c9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:11.792739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa36b0f556e140d5bdb5cb107c1987c9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:11.812096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa36b0f556e140d5bdb5cb107c1987c9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:11.825326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa36b0f556e140d5bdb5cb107c1987c9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:11.826093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa36b0f556e140d5bdb5cb107c1987c9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:11.840500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 750/1507] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:23:11 2022] DELETE /identity/v3/users/aa36b0f556e140d5bdb5cb107c1987c9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:23:11.844970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.845260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.845539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:11.862417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:23:11.863607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:11.924130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 758/1508] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:23:11.934899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:11.936331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:11.992307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa66d4-4c56-4780-bd14-cb5fb9d755d6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:11.996386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e90f-5027-4e16-bc50-01c69268f200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:11.997272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e90f-5027-4e16-bc50-01c69268f200 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:11.997561 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e90f-5027-4e16-bc50-01c69268f200 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:11.997868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e90f-5027-4e16-bc50-01c69268f200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:12.007699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67e90f-5027-4e16-bc50-01c69268f200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:12.009529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67e90f-5027-4e16-bc50-01c69268f200 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:12.022555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 751/1509] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:23:12.347951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:23:12.349454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:23:12.361980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30387-b9d4-439e-ba2e-859817bed8a0 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:23:12.367594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:23:12.368578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:23:12.368924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:23:12.369300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] PATH_INFO: `/v3/projects/52a0e4a5251d48178e6bf6967928600e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:23:12.370769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a0e4a5251d48178e6bf6967928600e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:23:12.372467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:23:12.372467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:23:12.372467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:23:12.373778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:23:12.434331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a0e4a5251d48178e6bf6967928600e', 'request_id': 'req-014a3172-0a93-4e8c-b11f-35272e06c116'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:12.447349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a0e4a5251d48178e6bf6967928600e', 'request_id': 'req-014a3172-0a93-4e8c-b11f-35272e06c116'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:12.453967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a0e4a5251d48178e6bf6967928600e', 'request_id': 'req-014a3172-0a93-4e8c-b11f-35272e06c116'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:12.468722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] The token cache is being invalidate because project 52a0e4a5251d48178e6bf6967928600e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:23:12.469017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:12.469747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-014a3172-0a93-4e8c-b11f-35272e06c116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:23:12.471332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 759/1510] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:23:12 2022] DELETE /identity/v3/projects/52a0e4a5251d48178e6bf6967928600e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:24:51.162255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf675d-9d24-4fe2-bda6-b9516ee47bcf None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:51.162864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf675d-9d24-4fe2-bda6-b9516ee47bcf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:51.162864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf675d-9d24-4fe2-bda6-b9516ee47bcf None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:51.164256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:24:51.170195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa7c4-5a1a-4042-aead-5b8a6a82404b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:51.170858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa7c4-5a1a-4042-aead-5b8a6a82404b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:51.170996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa7c4-5a1a-4042-aead-5b8a6a82404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:51.190500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-162aa7c4-5a1a-4042-aead-5b8a6a82404b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:24:51.191679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-162aa7c4-5a1a-4042-aead-5b8a6a82404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:24:51.247588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:24:51.416874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf675d-9d24-4fe2-bda6-b9516ee47bcf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:24:51.418503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-15bf675d-9d24-4fe2-bda6-b9516ee47bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:24:51.490280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf675d-9d24-4fe2-bda6-b9516ee47bcf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:24:51.495806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff1096-0688-44ec-b6d6-5acd8e93ea63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:24:51.496449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff1096-0688-44ec-b6d6-5acd8e93ea63 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:51.496733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff1096-0688-44ec-b6d6-5acd8e93ea63 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:51.497012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff1096-0688-44ec-b6d6-5acd8e93ea63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:51.505686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff1096-0688-44ec-b6d6-5acd8e93ea63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:24:51.507295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff1096-0688-44ec-b6d6-5acd8e93ea63 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:24:51.516438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 753/1513] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:24:52.383525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f538c-a5c7-43ce-be49-5b6cbf689e77 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:52.384102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f538c-a5c7-43ce-be49-5b6cbf689e77 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:52.384211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f538c-a5c7-43ce-be49-5b6cbf689e77 None None] PATH_INFO: `/v3` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:52.385600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 761/1514] 10.222.0.13 () {54 vars in 925 bytes} [Fri May 13 18:24:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:24:52.392922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969b90c-b3d2-40f9-96e6-431048504d11 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:52.393347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969b90c-b3d2-40f9-96e6-431048504d11 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:52.393517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969b90c-b3d2-40f9-96e6-431048504d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:52.413741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5969b90c-b3d2-40f9-96e6-431048504d11 None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:24:52.414959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5969b90c-b3d2-40f9-96e6-431048504d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:24:52.425775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e415f-445c-4142-a2e4-f063d662e1ae None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:52.426179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e415f-445c-4142-a2e4-f063d662e1ae None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:52.426537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e415f-445c-4142-a2e4-f063d662e1ae None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:52.428057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 762/1515] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 18:24:52.432693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:52.432978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:52.433256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:52.450803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:24:52.452081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:24:52.461832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 763/1516] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:24:52.476886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 754/1517] 10.222.0.13 () {58 vars in 1015 bytes} [Fri May 13 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:24:52.615203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:24:52.627392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0836-d1a6-49c8-98fc-16d64ac1a679 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:24:52.632662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92ba54-df8e-43fa-a425-051b924fe0fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:24:52.633302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92ba54-df8e-43fa-a425-051b924fe0fd service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:24:52.633591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92ba54-df8e-43fa-a425-051b924fe0fd service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:24:52.633901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92ba54-df8e-43fa-a425-051b924fe0fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:24:52.641815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92ba54-df8e-43fa-a425-051b924fe0fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:24:52.643423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92ba54-df8e-43fa-a425-051b924fe0fd service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:24:52.652544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 764/1518] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:25:01.401228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667a96-bc26-455e-9da9-4d25b6fd18f2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:01.401763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667a96-bc26-455e-9da9-4d25b6fd18f2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:01.401763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667a96-bc26-455e-9da9-4d25b6fd18f2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:01.403144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 755/1519] 10.222.0.84 () {54 vars in 960 bytes} [Fri May 13 18:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:01.408556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e21f-9953-445d-9312-c3d5c36c38ae None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:01.409014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e21f-9953-445d-9312-c3d5c36c38ae None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:01.409127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e21f-9953-445d-9312-c3d5c36c38ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:01.427666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-6499e21f-9953-445d-9312-c3d5c36c38ae None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:01.428853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6499e21f-9953-445d-9312-c3d5c36c38ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:01.437643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 765/1520] 10.222.0.84 () {58 vars in 1057 bytes} [Fri May 13 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:01.444930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667a96-bc26-455e-9da9-4d25b6fd18f2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:01.457532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667a96-bc26-455e-9da9-4d25b6fd18f2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:01.462524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57b818-1def-4243-88ae-a5e82c265261 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:01.462930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b818-1def-4243-88ae-a5e82c265261 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:01.463208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b818-1def-4243-88ae-a5e82c265261 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:01.463480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b818-1def-4243-88ae-a5e82c265261 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:01.472300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57b818-1def-4243-88ae-a5e82c265261 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:01.473892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57b818-1def-4243-88ae-a5e82c265261 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:01.483966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 756/1521] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:25:03.969243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef1b4-d81f-4caf-9898-282299b301f2 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:03.969872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef1b4-d81f-4caf-9898-282299b301f2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:03.969872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef1b4-d81f-4caf-9898-282299b301f2 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:03.971237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:03.975984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5195-1cdb-471e-89bc-ad439583e915 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:03.976404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5195-1cdb-471e-89bc-ad439583e915 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:03.976544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5195-1cdb-471e-89bc-ad439583e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:03.994854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-153b5195-1cdb-471e-89bc-ad439583e915 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:03.996029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-153b5195-1cdb-471e-89bc-ad439583e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:04.003790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:04.155211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef1b4-d81f-4caf-9898-282299b301f2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:04.169136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef1b4-d81f-4caf-9898-282299b301f2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:04.175255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfddc47-867c-4a04-8ed2-e83038b98307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:04.175889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfddc47-867c-4a04-8ed2-e83038b98307 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:04.176177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfddc47-867c-4a04-8ed2-e83038b98307 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:04.176458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfddc47-867c-4a04-8ed2-e83038b98307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:04.184356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfddc47-867c-4a04-8ed2-e83038b98307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:04.186559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfddc47-867c-4a04-8ed2-e83038b98307 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:04.195703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 767/1524] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:25:05.084186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea0c9-f5a3-440d-a3a6-6efc5e23faa8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:05.084733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea0c9-f5a3-440d-a3a6-6efc5e23faa8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:05.084733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea0c9-f5a3-440d-a3a6-6efc5e23faa8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:05.086188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 18:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:05.091056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6579-65fc-495e-af40-c9aaa975a360 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:05.092155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6579-65fc-495e-af40-c9aaa975a360 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:05.092155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6579-65fc-495e-af40-c9aaa975a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:05.110031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ffcc6579-65fc-495e-af40-c9aaa975a360 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:05.111195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ffcc6579-65fc-495e-af40-c9aaa975a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:05.119015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:05.268727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea0c9-f5a3-440d-a3a6-6efc5e23faa8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:05.283227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea0c9-f5a3-440d-a3a6-6efc5e23faa8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:05.288434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0131-1d44-4a98-9f08-ba21bb11cb7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:05.289050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0131-1d44-4a98-9f08-ba21bb11cb7a service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:05.289326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0131-1d44-4a98-9f08-ba21bb11cb7a service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:05.289596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0131-1d44-4a98-9f08-ba21bb11cb7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:05.297900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0131-1d44-4a98-9f08-ba21bb11cb7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:05.299452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0131-1d44-4a98-9f08-ba21bb11cb7a service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:05.308459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 759/1527] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:25:09.448625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3496a-d459-4f4f-b3ad-0d914edffa2d None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:09.449211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3496a-d459-4f4f-b3ad-0d914edffa2d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:09.449211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3496a-d459-4f4f-b3ad-0d914edffa2d None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:09.451096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:09.456424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30893-8cfb-4394-a84d-bf935509c278 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:09.456838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30893-8cfb-4394-a84d-bf935509c278 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:09.460268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30893-8cfb-4394-a84d-bf935509c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:09.478513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d4d30893-8cfb-4394-a84d-bf935509c278 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:09.479689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d4d30893-8cfb-4394-a84d-bf935509c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:09.487953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:09.523589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3496a-d459-4f4f-b3ad-0d914edffa2d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:09.525284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-13d3496a-d459-4f4f-b3ad-0d914edffa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:09.580533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3496a-d459-4f4f-b3ad-0d914edffa2d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:09.584019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335b153-178f-4909-9cd8-b00c55401e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:09.584651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335b153-178f-4909-9cd8-b00c55401e20 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:09.584930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335b153-178f-4909-9cd8-b00c55401e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:09.585201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335b153-178f-4909-9cd8-b00c55401e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:09.594451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335b153-178f-4909-9cd8-b00c55401e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:09.595860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335b153-178f-4909-9cd8-b00c55401e20 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:09.604893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 770/1530] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:25:11.793465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a192bd-d4c3-4d7f-800c-8486ce648cc1 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:11.794049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a192bd-d4c3-4d7f-800c-8486ce648cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:11.794049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a192bd-d4c3-4d7f-800c-8486ce648cc1 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:11.795480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:11.800788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab163-c336-48c9-a016-ac292c383cc5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:11.801205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab163-c336-48c9-a016-ac292c383cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:11.801382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab163-c336-48c9-a016-ac292c383cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:11.819291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-081ab163-c336-48c9-a016-ac292c383cc5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:11.820471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-081ab163-c336-48c9-a016-ac292c383cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:11.829271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:11.864254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a192bd-d4c3-4d7f-800c-8486ce648cc1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:11.875623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a192bd-d4c3-4d7f-800c-8486ce648cc1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:11.879134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb2eb6-b670-4074-aab4-be26bc5dd577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:11.879759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2eb6-b670-4074-aab4-be26bc5dd577 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:11.880034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2eb6-b670-4074-aab4-be26bc5dd577 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:11.880303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2eb6-b670-4074-aab4-be26bc5dd577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:11.889632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2eb6-b670-4074-aab4-be26bc5dd577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:11.891077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2eb6-b670-4074-aab4-be26bc5dd577 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:11.900071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 762/1533] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:25:15.566309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e58e8d-935d-405c-a61e-79dfe0a65757 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:15.566869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e58e8d-935d-405c-a61e-79dfe0a65757 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:15.566869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e58e8d-935d-405c-a61e-79dfe0a65757 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:15.568291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:15.573310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923f3c1-b8ff-4c1e-8834-c54808cd85ce None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:15.573763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923f3c1-b8ff-4c1e-8834-c54808cd85ce None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:15.573903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923f3c1-b8ff-4c1e-8834-c54808cd85ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:15.592565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1923f3c1-b8ff-4c1e-8834-c54808cd85ce None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:15.593746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1923f3c1-b8ff-4c1e-8834-c54808cd85ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:15.601420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:15.873417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e58e8d-935d-405c-a61e-79dfe0a65757 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:15.875063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e4e58e8d-935d-405c-a61e-79dfe0a65757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:15.928900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e58e8d-935d-405c-a61e-79dfe0a65757 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:15.932381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be5688-52f5-423e-a0a2-3f2c61ce62fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:15.933016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be5688-52f5-423e-a0a2-3f2c61ce62fe service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:15.933297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be5688-52f5-423e-a0a2-3f2c61ce62fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:15.933569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be5688-52f5-423e-a0a2-3f2c61ce62fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:15.942635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be5688-52f5-423e-a0a2-3f2c61ce62fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:15.944042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be5688-52f5-423e-a0a2-3f2c61ce62fe service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:15.953688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 773/1536] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:25:18.238257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc623-55fd-4c5c-aa51-48415b4947f2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:18.238924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc623-55fd-4c5c-aa51-48415b4947f2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:18.238924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc623-55fd-4c5c-aa51-48415b4947f2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:18.240180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 18:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:25:18.245807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296055b-28c7-4978-a3dd-b2141eefdb86 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:18.246217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296055b-28c7-4978-a3dd-b2141eefdb86 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:18.246378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296055b-28c7-4978-a3dd-b2141eefdb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:18.265261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c296055b-28c7-4978-a3dd-b2141eefdb86 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:25:18.266487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c296055b-28c7-4978-a3dd-b2141eefdb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:18.274130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 18:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:25:18.548123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc623-55fd-4c5c-aa51-48415b4947f2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:25:18.549842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-57bdc623-55fd-4c5c-aa51-48415b4947f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:25:18.562509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc623-55fd-4c5c-aa51-48415b4947f2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:25:18.566003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04833715-7274-442d-bceb-e8cc4cab1677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:25:18.566631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04833715-7274-442d-bceb-e8cc4cab1677 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:25:18.566911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04833715-7274-442d-bceb-e8cc4cab1677 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:25:18.567184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04833715-7274-442d-bceb-e8cc4cab1677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:25:18.576320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04833715-7274-442d-bceb-e8cc4cab1677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:25:18.577733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04833715-7274-442d-bceb-e8cc4cab1677 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:25:18.587015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 765/1539] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:45.623374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:45.624496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:45.625013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:45.655203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:45.656750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:45.672577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 775/1540] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:26:45.683007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:45.683975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:45.685358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:45.710788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:45.712427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:45.721377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 766/1541] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:45.726470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:45.736446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2757f-c6ac-42cb-a686-669bd92cc499 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:45.747134 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:45.748095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:45.748590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:45.749080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:45.750047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:45.750576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:45.752389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:45.769908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 776/1542] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:45.774607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:45.786983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f4b6-1d0f-47c9-9dea-ba5ebf8f5056 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:45.798176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:45.799170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:45.799665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:45.800159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:45.801086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:45.803252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:45.848622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 767/1543] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:45 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:26:45.853302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:45.867205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e0fd-5724-4f5e-8d80-8a09261eae12 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:45.937497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:45.938251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:45.938532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:45.938808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:45.939729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:45.941871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:45.977068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 777/1544] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:45 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:45.982186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:45.996860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ed19-0eb2-44bc-b8c9-d967fdb37e27 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.010302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.011389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.011887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.012374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.013338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.015802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.034131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 768/1545] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:46.038875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.057180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2983-121e-4eb9-8237-7e5ea9724370 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.066114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97464d-5125-4804-b2d4-829cf150ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.066897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97464d-5125-4804-b2d4-829cf150ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.067244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97464d-5125-4804-b2d4-829cf150ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.067526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97464d-5125-4804-b2d4-829cf150ce9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.068263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97464d-5125-4804-b2d4-829cf150ce9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.070051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97464d-5125-4804-b2d4-829cf150ce9e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.084672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 778/1546] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:46.089445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.105155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8636bad-9e3b-45bb-89a8-705fa4c8d2a9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.114094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.115291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.115807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.116327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] PATH_INFO: `/v3/projects/4a8efc83ba80448cbc3b6c90c9b795e0/users/dd332b3dceba4024b760443ff496071c/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.139229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8efc83ba80448cbc3b6c90c9b795e0, user_id=dd332b3dceba4024b760443ff496071c, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.142279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.167259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 769/1547] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:46 2022] PUT /identity/v3/projects/4a8efc83ba80448cbc3b6c90c9b795e0/users/dd332b3dceba4024b760443ff496071c/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:46.178829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2225d-ca70-4378-94a5-a6e35be2bdef None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.179185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2225d-ca70-4378-94a5-a6e35be2bdef None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.179468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2225d-ca70-4378-94a5-a6e35be2bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.230045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-afc2225d-ca70-4378-94a5-a6e35be2bdef None None] MFA Rules not processed for user `dd332b3dceba4024b760443ff496071c`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.231314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-afc2225d-ca70-4378-94a5-a6e35be2bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.335230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 779/1548] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.342969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.447393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ffd0-9228-4005-b238-7e6a3b87d91f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.458288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f7a7d-f645-474a-895e-919ee1f00bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.459311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7a7d-f645-474a-895e-919ee1f00bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.459829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7a7d-f645-474a-895e-919ee1f00bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.460315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7a7d-f645-474a-895e-919ee1f00bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.461457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f7a7d-f645-474a-895e-919ee1f00bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.463858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.464152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.464285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f7a7d-f645-474a-895e-919ee1f00bfd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.464460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.497815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.499838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.510541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 770/1549] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:46.511946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db22-1da8-4ea8-a5d6-6a8f74a6521c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.512316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db22-1da8-4ea8-a5d6-6a8f74a6521c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.512609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db22-1da8-4ea8-a5d6-6a8f74a6521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.515594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 780/1550] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.519594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.531161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9dbcf-0671-4c91-9820-f48355d48eea None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.543717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-aaf2db22-1da8-4ea8-a5d6-6a8f74a6521c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.545011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aaf2db22-1da8-4ea8-a5d6-6a8f74a6521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.626086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 771/1551] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.628433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b711-4d6a-4295-9e24-9a9592a626c9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.628894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b711-4d6a-4295-9e24-9a9592a626c9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.629335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b711-4d6a-4295-9e24-9a9592a626c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.638651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3f20a-cd43-47c9-8d9d-c7df9bac9b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.639382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f20a-cd43-47c9-8d9d-c7df9bac9b3d admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.639614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f20a-cd43-47c9-8d9d-c7df9bac9b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.639889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f20a-cd43-47c9-8d9d-c7df9bac9b3d admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.640591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3f20a-cd43-47c9-8d9d-c7df9bac9b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.643993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3f20a-cd43-47c9-8d9d-c7df9bac9b3d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.655880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9b78b711-4d6a-4295-9e24-9a9592a626c9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.657707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9b78b711-4d6a-4295-9e24-9a9592a626c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.667909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 772/1552] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.669704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9275654-67a8-4266-be52-0953ff1fb44a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.670294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9275654-67a8-4266-be52-0953ff1fb44a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.670799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9275654-67a8-4266-be52-0953ff1fb44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.674981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 781/1553] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:26:46.676325 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e092e0-a8a9-4e9f-8d94-fe2542a35a9d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.676616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e092e0-a8a9-4e9f-8d94-fe2542a35a9d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.676964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e092e0-a8a9-4e9f-8d94-fe2542a35a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.698243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c9275654-67a8-4266-be52-0953ff1fb44a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.698823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-94e092e0-a8a9-4e9f-8d94-fe2542a35a9d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.699586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-94e092e0-a8a9-4e9f-8d94-fe2542a35a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.700429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c9275654-67a8-4266-be52-0953ff1fb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.707350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 782/1554] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.708571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.708858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.714067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 773/1555] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.714256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.714368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.714368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.714368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.734251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.734587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.735468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.735650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.747104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 774/1556] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.748059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 783/1557] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.748184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.753288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.757566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed7fd7-1d1d-4bd7-af41-663566a8d0bd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.763095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.763320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab00b9-f004-4fe0-92e2-1f79a0300188 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.763748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.764026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.764299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.765022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:46.765323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.766400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 18:26:46.766400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:26:46.766400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:26:46.767398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd2333-474e-49f7-a46a-ec26a6b6d83e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.767865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9f9e3-37ae-47fa-a2aa-2a869a40e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.768518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f9e3-37ae-47fa-a2aa-2a869a40e613 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.768806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f9e3-37ae-47fa-a2aa-2a869a40e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.769081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f9e3-37ae-47fa-a2aa-2a869a40e613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.769818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9f9e3-37ae-47fa-a2aa-2a869a40e613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.771528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9f9e3-37ae-47fa-a2aa-2a869a40e613 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.779216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 775/1558] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:46.781403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700b7ce-8701-48cc-9bc0-09c2f133e398 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.781846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 784/1559] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:46.782107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700b7ce-8701-48cc-9bc0-09c2f133e398 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.782572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700b7ce-8701-48cc-9bc0-09c2f133e398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.783072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086bcd-8077-461d-ba99-c6a50e5c0988 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.783360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086bcd-8077-461d-ba99-c6a50e5c0988 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.783639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086bcd-8077-461d-ba99-c6a50e5c0988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.801257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-99086bcd-8077-461d-ba99-c6a50e5c0988 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.801477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f700b7ce-8701-48cc-9bc0-09c2f133e398 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.802465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-99086bcd-8077-461d-ba99-c6a50e5c0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.802605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f700b7ce-8701-48cc-9bc0-09c2f133e398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.813898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 785/1561] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.814081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 776/1561] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.814081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155e1a-3395-4f2f-aadb-7a579d41043a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.814262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.814357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155e1a-3395-4f2f-aadb-7a579d41043a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.814488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.814585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155e1a-3395-4f2f-aadb-7a579d41043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.814681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.831306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ac155e1a-3395-4f2f-aadb-7a579d41043a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.831497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.832569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ac155e1a-3395-4f2f-aadb-7a579d41043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.832704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.840944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 786/1562] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.846000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 777/1563] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.846141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.846323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.846323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.846323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.853597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c2af4-ef40-487b-a7b9-d6137290f987 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.858145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.858797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.859081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.859357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.860079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:46.860383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.862009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.865047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.866240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.873788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 787/1564] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:46.874588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.875132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 778/1565] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:46.875716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.885812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8a4b0-36b1-43cd-b163-b1ca7655477e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.886479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a877b-322f-48cd-ab06-4ceb34b53f3b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.890329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.890860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.891236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.891490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.891606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.891778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.891904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] PATH_INFO: `/v3/projects/19f5dd85cac54120aac070a453c110aa/users/ad5b070a6c5345d0913d0618b09c370b/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.892080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.892712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.894623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.907494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f5dd85cac54120aac070a453c110aa, user_id=ad5b070a6c5345d0913d0618b09c370b, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.908530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:26:46.908530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:26:46.908530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:26:46.910609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f142a-4e6e-4da4-a3cd-dfa92ccaddcc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:46.919994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 779/1566] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:46.920897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:46.926972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 788/1567] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:46 2022] PUT /identity/v3/projects/19f5dd85cac54120aac070a453c110aa/users/ad5b070a6c5345d0913d0618b09c370b/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:46.926972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f1cc-2e01-431a-bf19-1d92f66b7609 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.926972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f1cc-2e01-431a-bf19-1d92f66b7609 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.926972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f1cc-2e01-431a-bf19-1d92f66b7609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.943586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-6847f1cc-2e01-431a-bf19-1d92f66b7609 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:46.944802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6847f1cc-2e01-431a-bf19-1d92f66b7609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:46.980853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947c70-6637-45d4-b6d1-d59de5db8951 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:46.985425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:46.986098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:46.986377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:46.986650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:46.987366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:46.987663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:46.989242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.001236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 780/1568] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:47.002002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.008780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 789/1569] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:47.010713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.011168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.011449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.016213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9569b38-ccd1-4661-b3fa-51993ff84bd8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.021005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.021648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.021961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.022259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.022939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:47.023241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.024869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.029508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:47.030762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:47.036840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 781/1570] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:47.037554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.042392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 790/1571] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:47.043377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.050180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670c713-3c70-4159-a405-afdc8feabb35 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.053647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe16830-242e-4b8b-833b-e13da63d46b7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.054671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.055311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.055592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.055867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.057108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.059037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.059171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.059679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.059959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.060238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.060966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:47.061274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.062908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.074770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 791/1572] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:47.075715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.084119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 782/1573] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.085180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.085629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49fd0-93ed-4765-83c9-98d19ec2d3c3 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.142029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.142694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.142980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.143252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.143935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.145685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e5ae-4a05-45cf-9ea4-dbb292b02231 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.145886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.151475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.152185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.152488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.152768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.153531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.155180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.166023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 783/1574] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.169766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.169935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 792/1575] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.170633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.176197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f476-1025-4599-bf64-19ecd78bb2d8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.179937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89813b3-ec34-4752-bd75-b72db85510cb admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.180612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.181278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.181597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.181960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.182639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.184498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.184942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.185584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.185902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.186180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.186900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:47.187215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.188771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.200869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 793/1576] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:47.201724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.210779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e89d2-684f-4e23-9edd-6b9d58b153f3 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.216089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.216253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 784/1577] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.216863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.217233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.217370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.217648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.218411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.219605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:26:47.219605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:26:47.219605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:26:47.220778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.249563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 794/1578] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.249563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.279956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c54bb-77a5-4034-a99d-f4f2d05d7654 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.310483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576e874-ea20-4d30-bb04-dbdc9b9848f7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.315109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.315771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.316058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.316331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.317026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.318962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.338474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.339198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.339513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.339809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.340447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:47.340819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.342492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.347351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 795/1579] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.348241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.354768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 785/1580] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:47.355529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.369294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7c6cc-b4ed-4641-9920-fb237f9d4dc2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.420013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d19ef6-561a-4009-a491-728fba5cf2a9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.425145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.425876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.426165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.426440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.427143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.428710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.429051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.429592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.429903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.430175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] PATH_INFO: `/v3/projects/19f5dd85cac54120aac070a453c110aa/users/ad5b070a6c5345d0913d0618b09c370b/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.432220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f5dd85cac54120aac070a453c110aa, user_id=ad5b070a6c5345d0913d0618b09c370b, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.434890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.445833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 786/1581] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:47 2022] PUT /identity/v3/projects/19f5dd85cac54120aac070a453c110aa/users/ad5b070a6c5345d0913d0618b09c370b/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:47.446840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.456473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 796/1582] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.457367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.470034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c2f50-adbc-4a95-b8ba-0f9b99e6c820 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.518653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9638c4-f359-433c-bd69-8bed56fbe9f1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.523659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.524329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.524632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.525863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.526251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.526635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.527300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.527581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.527857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.527966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.528550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.530519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.537520 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 787/1583] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.538340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.550659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae72c68-05c8-44d3-ac13-3f9f9f7138d5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.555414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.556267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.556543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.556656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 797/1584] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.557073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.557454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.557984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.559106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:26:47.559106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:26:47.559106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:26:47.560286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.580611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 788/1585] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.584330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.594114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376aa58-a8cb-40df-9662-69ef0ba16f5d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.619188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5ff0-5a53-406a-958a-700b63b2f515 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.624007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.624723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.625014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.625288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.626015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.628259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.647871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 798/1586] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.648672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.651706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363b58b-f9a2-47e0-a8f1-259bfdfcf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.652380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363b58b-f9a2-47e0-a8f1-259bfdfcf7de admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.652738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363b58b-f9a2-47e0-a8f1-259bfdfcf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.653089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363b58b-f9a2-47e0-a8f1-259bfdfcf7de admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.653872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363b58b-f9a2-47e0-a8f1-259bfdfcf7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.655875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363b58b-f9a2-47e0-a8f1-259bfdfcf7de admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.658386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb707a9-5ac3-44f0-9079-12e736f58473 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.662846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.663484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.663765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.664036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.664712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.666874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.676401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 789/1587] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.678135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.678485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.678765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.692962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 799/1588] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.693907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.706902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] MFA Rules not processed for user `ad5b070a6c5345d0913d0618b09c370b`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:47.708074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:47.753304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3cf5e-b96e-4075-9ee0-8722ff6de34f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.757885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.758548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.758831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.759643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.760371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.761988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.771501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 800/1589] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.775286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.779079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 790/1590] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:47.779941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.787191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886af8f-d00b-4249-bd50-4bbf047c6abe admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.790002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e855-41d7-4343-a17e-1d25b54b8562 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.791995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.792653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.792938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.793215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.794087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.794621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.795279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.795564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.795704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.795840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.796529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.798512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.809556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 801/1591] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.809556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.816984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fc52e-a393-4e6c-bb16-d05b4b5863f9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.822224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.822887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.823165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.823439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.826717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 791/1592] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.826866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.826965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.827076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.835780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17269f-eb3c-49f4-8cb5-8dace88174c1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.836815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 802/1593] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.838197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.841371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.842061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.842342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.842614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.843344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.844924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.847445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac9cdf-a1f6-4528-b4fe-36ab1d0477dc admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.852024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.852669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.853002 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.853276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.854193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.857562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 792/1594] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.857562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.857761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.865221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b245de7-f4c0-498f-9863-86dbc65e3c30 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.865994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 803/1595] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.870527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.871276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.871942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.872227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.872506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.873187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.875134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.879763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc39438-e613-4db4-9834-908dde15f164 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.885201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.885867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.886186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.886418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.887290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.889217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.896299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 793/1596] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:47 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:47.897200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.902337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 804/1597] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:47.902337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.911619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6042-c9e5-4f45-b828-491f720756af admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:47.916185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:47.917033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:47.917319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:47.917591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] PATH_INFO: `/v3/projects/dccc59cf460f42e29c71e68a5ccf3f11/users/c71c766f139647d38980ae606a882928/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:47.932461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccc59cf460f42e29c71e68a5ccf3f11, user_id=c71c766f139647d38980ae606a882928, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:47.935292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:47.955464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 805/1598] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:47 2022] PUT /identity/v3/projects/dccc59cf460f42e29c71e68a5ccf3f11/users/c71c766f139647d38980ae606a882928/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:47.955464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:47.960616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006538c-c495-43b6-9ab5-e4de11345284 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.007181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.007825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.008109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.008383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.017590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e297f7-df4a-490f-9e87-c9f72a56fd6d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.022780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.023472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.023753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.024026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.024795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.026579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.036238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 806/1599] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.037056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.047049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f200-6795-4a8e-b1fa-0d05ef19b9ef admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.051672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.052311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.052624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.052896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.053624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.055234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.065522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 807/1600] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.066525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.070090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.071580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.076398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d8e24-f4ed-4e37-b737-4d59a466544e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.080973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.081591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 794/1601] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:48.081978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.082258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.082427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.082545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.083419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.084979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.092103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f3a1e-5d24-4d35-a6ca-cd29a0e5af88 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.099172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 808/1602] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.099338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.099338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.099538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.099634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.099634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.099634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.100165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.109140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2db7-b5ed-4765-830b-8611fa3c2df5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.111369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 795/1603] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.112226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.113876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a365-507f-4fde-90b6-cebe065263ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.114852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a365-507f-4fde-90b6-cebe065263ea admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.115138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a365-507f-4fde-90b6-cebe065263ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.115413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a365-507f-4fde-90b6-cebe065263ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.116165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a365-507f-4fde-90b6-cebe065263ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.118046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a365-507f-4fde-90b6-cebe065263ea admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.127933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5dea7-7431-42c9-a5b6-6f4c126aaf2d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.132481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.133094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 809/1604] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.133364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.133763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.134677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] PATH_INFO: `/v3/projects/0856aad5f2a04ad5aacde0070bbca853/users/bdf0ad3b9d3040e882cc75085370cf19/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.135096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.135380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.135654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.150086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0856aad5f2a04ad5aacde0070bbca853, user_id=bdf0ad3b9d3040e882cc75085370cf19, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.152736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.167290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] MFA Rules not processed for user `c71c766f139647d38980ae606a882928`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:48.168379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 796/1605] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:48 2022] PUT /identity/v3/projects/0856aad5f2a04ad5aacde0070bbca853/users/bdf0ad3b9d3040e882cc75085370cf19/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:48.168524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:48.171030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.231943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b63b34-3589-4505-aded-8b1e1cd569ea admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.235448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 810/1606] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:48.236244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.238439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.239289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.239577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.239857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.240589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.242491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.247646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c102b-4f49-4631-aa40-229cfab8c744 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.252160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.252907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 797/1607] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.253029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.253297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.253573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] PATH_INFO: `/v3/projects/912db730eef84d22b00456e1623401a4/users/20bc6ed6c7cb4aff9e19d65e652043bd/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.253670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.263040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577658-8414-4bba-bbbe-7c5f02e049f1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.267569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.268238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] RBAC: Authorizing `identity:create_grant(project_id=912db730eef84d22b00456e1623401a4, user_id=20bc6ed6c7cb4aff9e19d65e652043bd, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.268419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.268702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.268988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] PATH_INFO: `/v3/projects/13b282e27b404c7dbefc9de2ea947595/users/146368a389f94e2fbe6776bb27d60378/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.270941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.284191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b282e27b404c7dbefc9de2ea947595, user_id=146368a389f94e2fbe6776bb27d60378, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.285255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 811/1608] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:48 2022] PUT /identity/v3/projects/912db730eef84d22b00456e1623401a4/users/20bc6ed6c7cb4aff9e19d65e652043bd/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:48.286218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.292654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.305355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 798/1609] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:48 2022] PUT /identity/v3/projects/13b282e27b404c7dbefc9de2ea947595/users/146368a389f94e2fbe6776bb27d60378/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:48.309663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.346128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc820438-cf89-4dc7-869c-ea038d6f93de admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.370737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcceb44-b429-410f-bf35-434d562b70a2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.375244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000355-91ea-4f21-bb2f-253ab728970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.375908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000355-91ea-4f21-bb2f-253ab728970f admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.376192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000355-91ea-4f21-bb2f-253ab728970f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.376468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000355-91ea-4f21-bb2f-253ab728970f admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.377189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77000355-91ea-4f21-bb2f-253ab728970f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.378933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77000355-91ea-4f21-bb2f-253ab728970f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.388765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 799/1610] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:48.390015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.390306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.390593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.400891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.401773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.402093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.402363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] PATH_INFO: `/v3/projects/2ae50c654dcc41c5b071040530bf36ef/users/57d481d6b7d641838ca9128d2a366702/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.407253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:48.408449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:48.416932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae50c654dcc41c5b071040530bf36ef, user_id=57d481d6b7d641838ca9128d2a366702, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.417084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 800/1611] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:48.417736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.419940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.435630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 812/1612] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:48 2022] PUT /identity/v3/projects/2ae50c654dcc41c5b071040530bf36ef/users/57d481d6b7d641838ca9128d2a366702/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:48.436496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.473084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37ffe2-9c13-4c4b-8e8e-44938487031e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.497827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809c664-1999-4e81-b93a-400cdd6af9b5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.502452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.503159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.503447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.503725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.504421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.506374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.520620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17984e21-3c26-4f08-a0f5-c92718dfbf56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.521497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17984e21-3c26-4f08-a0f5-c92718dfbf56 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.521788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17984e21-3c26-4f08-a0f5-c92718dfbf56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.522097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17984e21-3c26-4f08-a0f5-c92718dfbf56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.531953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 813/1613] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:48.532930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.577838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17984e21-3c26-4f08-a0f5-c92718dfbf56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.579301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17984e21-3c26-4f08-a0f5-c92718dfbf56 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.588722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 801/1614] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:48.590145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.590442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.590731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.592179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e9ae-94b5-4891-b4cc-3fef77131e4f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.597971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36018d49-d682-4f50-8c69-b351d70aefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.598793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36018d49-d682-4f50-8c69-b351d70aefe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.599140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36018d49-d682-4f50-8c69-b351d70aefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.599478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36018d49-d682-4f50-8c69-b351d70aefe9 admin admin] PATH_INFO: `/v3/projects/8db17b57b02d441ab3b1c031153f6504/users/b8f4c6fecee64ac493b200f7e06ca61a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.614947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36018d49-d682-4f50-8c69-b351d70aefe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db17b57b02d441ab3b1c031153f6504, user_id=b8f4c6fecee64ac493b200f7e06ca61a, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.617940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36018d49-d682-4f50-8c69-b351d70aefe9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.623617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] MFA Rules not processed for user `20bc6ed6c7cb4aff9e19d65e652043bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:48.625383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:48.631654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 814/1615] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:48 2022] PUT /identity/v3/projects/8db17b57b02d441ab3b1c031153f6504/users/b8f4c6fecee64ac493b200f7e06ca61a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:48.633103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.633452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.633824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.654680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:48.656003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:48.706259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 802/1616] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:48.707422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.723057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 815/1617] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:48.724162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.725560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:48.787950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559357-6964-4b14-ae93-abe6f2061d9d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.792788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6f7c2-5740-46de-bf46-10baf3e6f490 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.793120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.794244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.794488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.794761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] PATH_INFO: `/v3/projects/ee2bafc77fbe4de6b6081f3daaa458b6/users/c7e0e02593ee4adaa804d0337e2f276d/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.797242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880407c9-d88d-4074-9536-59dbae344382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.798050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880407c9-d88d-4074-9536-59dbae344382 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.798633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880407c9-d88d-4074-9536-59dbae344382 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.799056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880407c9-d88d-4074-9536-59dbae344382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.812390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880407c9-d88d-4074-9536-59dbae344382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.814198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880407c9-d88d-4074-9536-59dbae344382 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.815424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2bafc77fbe4de6b6081f3daaa458b6, user_id=c7e0e02593ee4adaa804d0337e2f276d, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.818226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.826720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 816/1618] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:48.828229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270120-69c9-4534-a759-49c2bd67d4c5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.828443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270120-69c9-4534-a759-49c2bd67d4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.828718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270120-69c9-4534-a759-49c2bd67d4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.836061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 803/1619] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:48 2022] PUT /identity/v3/projects/ee2bafc77fbe4de6b6081f3daaa458b6/users/c7e0e02593ee4adaa804d0337e2f276d/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:48.836981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.861635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2f270120-69c9-4534-a759-49c2bd67d4c5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:48.862876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2f270120-69c9-4534-a759-49c2bd67d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:48.906627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549684c-0bf7-41d7-9ef8-981994439145 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:48.912594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969b8fc-e8e4-4d0f-9ab1-b9edf6403dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:48.913364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969b8fc-e8e4-4d0f-9ab1-b9edf6403dfa admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.913647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969b8fc-e8e4-4d0f-9ab1-b9edf6403dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.914304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969b8fc-e8e4-4d0f-9ab1-b9edf6403dfa admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.914754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969b8fc-e8e4-4d0f-9ab1-b9edf6403dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:48.917779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969b8fc-e8e4-4d0f-9ab1-b9edf6403dfa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:48.928790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 817/1620] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:48.930426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc87c8-f946-4636-b313-2a74cb0fc403 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.930767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc87c8-f946-4636-b313-2a74cb0fc403 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.931190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc87c8-f946-4636-b313-2a74cb0fc403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.949054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 804/1621] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:48.949054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342956-5091-40df-8f0d-8927a87f1557 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:48.949054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342956-5091-40df-8f0d-8927a87f1557 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:48.949054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342956-5091-40df-8f0d-8927a87f1557 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:48.950554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 805/1622] 10.222.0.84 () {54 vars in 961 bytes} [Fri May 13 18:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:26:48.951377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342956-5091-40df-8f0d-8927a87f1557 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:48.959540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4bcc87c8-f946-4636-b313-2a74cb0fc403 None None] MFA Rules not processed for user `b8f4c6fecee64ac493b200f7e06ca61a`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:48.960739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4bcc87c8-f946-4636-b313-2a74cb0fc403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:49.022632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342956-5091-40df-8f0d-8927a87f1557 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.027363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.028009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.028462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.028746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.038829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.040299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.044054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 818/1623] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:49.046444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.046970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.047757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.051237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 806/1624] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:49.052086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.060973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1b28-0c7d-4099-b876-1dad2a7d2a26 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.069458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.072075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.072075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.072075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.080555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] MFA Rules not processed for user `c7e0e02593ee4adaa804d0337e2f276d`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:49.082008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:49.088933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.090730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.102087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 807/1625] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:49.103440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.112967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085008-65bc-4b76-9c85-760ffaa44613 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.118543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74761f8-c5d0-4513-b83c-e9e6d1175231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.119341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74761f8-c5d0-4513-b83c-e9e6d1175231 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.119810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74761f8-c5d0-4513-b83c-e9e6d1175231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.120160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74761f8-c5d0-4513-b83c-e9e6d1175231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.120967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74761f8-c5d0-4513-b83c-e9e6d1175231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.122785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74761f8-c5d0-4513-b83c-e9e6d1175231 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.138658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 808/1626] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:49.140775 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065bc1a-a8c1-495e-99ba-62df9f89d1b0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.141304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065bc1a-a8c1-495e-99ba-62df9f89d1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.142622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065bc1a-a8c1-495e-99ba-62df9f89d1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.167757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 819/1627] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:49.168022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e065bc1a-a8c1-495e-99ba-62df9f89d1b0 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:49.168875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.170105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e065bc1a-a8c1-495e-99ba-62df9f89d1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:49.184463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164bde-8bab-4adf-9ca5-4b75e4123557 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.189664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.190496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.191000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.191543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.192616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.195535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.238379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 820/1628] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:49.239703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.318447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 809/1629] 10.222.0.84 () {58 vars in 1058 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:49.320058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4e00-7292-49b8-b65b-0de9d4e9837e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.320605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4e00-7292-49b8-b65b-0de9d4e9837e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.320982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4e00-7292-49b8-b65b-0de9d4e9837e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.324896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 810/1630] 10.222.0.84 () {54 vars in 961 bytes} [Fri May 13 18:26:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:26:49.325867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4e00-7292-49b8-b65b-0de9d4e9837e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.326865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139728-c817-4fbe-a4dd-4e1e7cf5b8ef admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.332568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.333449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.333812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.334102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] PATH_INFO: `/v3/projects/0aa1326b206d4906835ad3e49885dc56/users/65e146b517514b3f9b5bb832d298e854/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.343709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4e00-7292-49b8-b65b-0de9d4e9837e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.350936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb55d-f733-4f46-b16e-22a0ece2aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.351937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb55d-f733-4f46-b16e-22a0ece2aac3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.352386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb55d-f733-4f46-b16e-22a0ece2aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.355985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa1326b206d4906835ad3e49885dc56, user_id=65e146b517514b3f9b5bb832d298e854, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.356877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb55d-f733-4f46-b16e-22a0ece2aac3 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.357753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb55d-f733-4f46-b16e-22a0ece2aac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.358656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.360298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb55d-f733-4f46-b16e-22a0ece2aac3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.388230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 821/1631] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:49 2022] PUT /identity/v3/projects/0aa1326b206d4906835ad3e49885dc56/users/65e146b517514b3f9b5bb832d298e854/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:49.389160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 811/1632] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/users => generated 297 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:49.390620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.391119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.391501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.394555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.504165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f77fbf-ee88-4c20-b329-79d7602751d6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.511557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.512245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.512583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.512869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.564232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:49.565580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:49.577763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 812/1633] 10.222.0.84 () {58 vars in 1058 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:49.578899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.638874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.640617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.651508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d66bd-6f56-461a-824e-ecf95b83c512 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.657027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 822/1634] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:49.658675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.661243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.661954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.662416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.662697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.663442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.665047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.673381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496bd2-6c96-4651-bd63-9ba34a2dff03 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.679833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.680761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.681218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.681533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.682465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.684228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.694525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 813/1635] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:49.695712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.699101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 823/1636] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:49.699955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.713369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1665713-b22e-4cdc-a117-7e2ad84c92bb admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.718198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.719357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.719643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.719922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] PATH_INFO: `/v3/projects/0aa1326b206d4906835ad3e49885dc56/users/65e146b517514b3f9b5bb832d298e854/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.721943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa1326b206d4906835ad3e49885dc56, user_id=65e146b517514b3f9b5bb832d298e854, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.723730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d0b24-990f-41c8-88d6-f5de146dd513 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.724865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.740892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234c58-1a40-4be4-be1f-b96501a5fd91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.741956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234c58-1a40-4be4-be1f-b96501a5fd91 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.742342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234c58-1a40-4be4-be1f-b96501a5fd91 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.742719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234c58-1a40-4be4-be1f-b96501a5fd91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.750724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 824/1637] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:49 2022] PUT /identity/v3/projects/0aa1326b206d4906835ad3e49885dc56/users/65e146b517514b3f9b5bb832d298e854/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:49.751729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:49.819879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234c58-1a40-4be4-be1f-b96501a5fd91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.822755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234c58-1a40-4be4-be1f-b96501a5fd91 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.833254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 814/1638] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:49.834710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.835070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.835416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.846993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ec0ac-32ff-4130-b07a-5475c08e2cfd admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:49.876762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fff8-7ed5-4140-9a17-d464723f0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:49.877633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fff8-7ed5-4140-9a17-d464723f0b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.877913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fff8-7ed5-4140-9a17-d464723f0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.878189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fff8-7ed5-4140-9a17-d464723f0b99 admin admin] PATH_INFO: `/v3/projects/5397beb9a41949d78823c8d30bb37f23/users/50602c4e4f14494ebc3b5dbdb3c09fb1/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:49.887471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] MFA Rules not processed for user `65e146b517514b3f9b5bb832d298e854`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:49.891633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:49.921369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fff8-7ed5-4140-9a17-d464723f0b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5397beb9a41949d78823c8d30bb37f23, user_id=50602c4e4f14494ebc3b5dbdb3c09fb1, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:49.924223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fff8-7ed5-4140-9a17-d464723f0b99 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:49.955529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 825/1639] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:49 2022] PUT /identity/v3/projects/5397beb9a41949d78823c8d30bb37f23/users/50602c4e4f14494ebc3b5dbdb3c09fb1/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:49.975015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b115-6d6a-4056-83eb-bac84035646d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:49.975628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b115-6d6a-4056-83eb-bac84035646d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:49.976161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b115-6d6a-4056-83eb-bac84035646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.003355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 815/1640] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:50.004299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:50.032672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9f89b115-6d6a-4056-83eb-bac84035646d None None] MFA Rules not processed for user `bdf0ad3b9d3040e882cc75085370cf19`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:50.034050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9f89b115-6d6a-4056-83eb-bac84035646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:50.063743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c445-5694-4fee-b10c-95b4d9511b15 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:50.171940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 826/1641] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:50.173609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b8c7-7407-4fdc-8b8f-5ae306c856ba None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.174544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b8c7-7407-4fdc-8b8f-5ae306c856ba None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.174544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b8c7-7407-4fdc-8b8f-5ae306c856ba None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.178235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 827/1642] 10.222.0.84 () {54 vars in 912 bytes} [Fri May 13 18:26:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:26:50.186898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b8c7-7407-4fdc-8b8f-5ae306c856ba None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:50.194504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb24b-7b21-494c-91fe-b03a18ef8f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:50.195181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb24b-7b21-494c-91fe-b03a18ef8f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.195462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb24b-7b21-494c-91fe-b03a18ef8f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.195737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb24b-7b21-494c-91fe-b03a18ef8f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.197389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb24b-7b21-494c-91fe-b03a18ef8f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:50.199066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb24b-7b21-494c-91fe-b03a18ef8f71 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:50.218231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 816/1643] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:50.219876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee557a-efcf-41ba-bb75-ceee94a7317a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.220937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee557a-efcf-41ba-bb75-ceee94a7317a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.221562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee557a-efcf-41ba-bb75-ceee94a7317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.250856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b6ee557a-efcf-41ba-bb75-ceee94a7317a None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:50.252628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b6ee557a-efcf-41ba-bb75-ceee94a7317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:50.278157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b8c7-7407-4fdc-8b8f-5ae306c856ba None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:50.282379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110929b5-c13b-4306-a380-c149720a9069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:50.283444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110929b5-c13b-4306-a380-c149720a9069 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.283906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110929b5-c13b-4306-a380-c149720a9069 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.284285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110929b5-c13b-4306-a380-c149720a9069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.367127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 817/1644] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:26:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:50.372142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e9f8c-1b77-4401-94d4-abdd06beb513 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.372637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e9f8c-1b77-4401-94d4-abdd06beb513 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.372921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e9f8c-1b77-4401-94d4-abdd06beb513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.379445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110929b5-c13b-4306-a380-c149720a9069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:50.381149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110929b5-c13b-4306-a380-c149720a9069 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:50.395471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 828/1645] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:50.396945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-475e9f8c-1b77-4401-94d4-abdd06beb513 None None] MFA Rules not processed for user `bdf0ad3b9d3040e882cc75085370cf19`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:50.397099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7ee6-2ccd-4b7a-8166-2b0fff84cd28 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.397372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7ee6-2ccd-4b7a-8166-2b0fff84cd28 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.397654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7ee6-2ccd-4b7a-8166-2b0fff84cd28 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.398725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-475e9f8c-1b77-4401-94d4-abdd06beb513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:50.403442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 829/1646] 10.222.0.84 () {54 vars in 912 bytes} [Fri May 13 18:26:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:26:50.404334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7ee6-2ccd-4b7a-8166-2b0fff84cd28 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:50.415392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 818/1647] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:50.419517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb98b5-3a6b-480b-be27-2bbf4d484a0d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.422505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb98b5-3a6b-480b-be27-2bbf4d484a0d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.423067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb98b5-3a6b-480b-be27-2bbf4d484a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.460117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7ee6-2ccd-4b7a-8166-2b0fff84cd28 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:50.479725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:50.482071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.482427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.482715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] PATH_INFO: `/v3/projects/5397beb9a41949d78823c8d30bb37f23/users/50602c4e4f14494ebc3b5dbdb3c09fb1/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.488758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-36fb98b5-3a6b-480b-be27-2bbf4d484a0d None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:50.490137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-36fb98b5-3a6b-480b-be27-2bbf4d484a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:50.491987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5397beb9a41949d78823c8d30bb37f23, user_id=50602c4e4f14494ebc3b5dbdb3c09fb1, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:50.498379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:50.507886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 819/1648] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:26:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:50.525108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 830/1649] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:50 2022] PUT /identity/v3/projects/5397beb9a41949d78823c8d30bb37f23/users/50602c4e4f14494ebc3b5dbdb3c09fb1/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:50.539464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.539751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.540859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.579173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] MFA Rules not processed for user `50602c4e4f14494ebc3b5dbdb3c09fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:50.580700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:50.592242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:50.669321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4cb3-9aac-4067-b1d5-99feef9e94ee admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:50.674543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:50.675489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:50.676032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:50.676502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:50.683960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 820/1650] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:50.764391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:50.766102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:50.794470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 831/1651] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:51.182779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:51.193650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02874cdc-bc31-46f4-a9a1-de44045af9c6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:51.205599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:51.206293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:51.206577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:51.207830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:51.231665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:51.235334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:51.262269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 821/1652] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:26:51.342701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:51.355214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510c34-25b8-431f-87f2-d12052f37d64 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:51.367101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:51.368393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:51.368894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:51.369340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:51.390109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:51.391566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:51.414692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 832/1653] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:51.855926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:51.873215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91dd11-a1c2-4728-a4b4-becf4375a507 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:51.888118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:51.888816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:51.889052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:51.889329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:51.898054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:52.017389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37083bb1-f7f9-4dd2-a0be-c777fdd18e96 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:52.032853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:52.034222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:52.034794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:52.036242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] PATH_INFO: `/v3/users/c71c766f139647d38980ae606a882928` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:52.039031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71c766f139647d38980ae606a882928)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:52.042858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: WARNING py.warnings [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:26:52.042858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: warnings.warn(msg) May 13 18:26:52.042858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: May 13 18:26:52.043204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:52.044555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:52.046181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:52.099850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 822/1654] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:52.101679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:52.131603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136c57-34fa-4f93-a993-36746db8c3f4 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:52.137041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d217-7d02-4e63-be31-458e515ee614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:52.137848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d217-7d02-4e63-be31-458e515ee614 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:52.138129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d217-7d02-4e63-be31-458e515ee614 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:52.138523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d217-7d02-4e63-be31-458e515ee614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:52.180625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71c766f139647d38980ae606a882928'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:52.183337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71c766f139647d38980ae606a882928'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:52.227362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71c766f139647d38980ae606a882928'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:52.246510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d217-7d02-4e63-be31-458e515ee614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:52.247962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d217-7d02-4e63-be31-458e515ee614 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:52.255813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71c766f139647d38980ae606a882928'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:52.256571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71c766f139647d38980ae606a882928'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:52.268498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 823/1655] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:52.276594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 833/1656] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:26:51 2022] DELETE /identity/v3/users/c71c766f139647d38980ae606a882928 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:26:52.281056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9d24-8dbf-42fc-b305-e7c0a2bb8bb2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:52.281670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9d24-8dbf-42fc-b305-e7c0a2bb8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:52.282156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe9d24-8dbf-42fc-b305-e7c0a2bb8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:52.302846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-aabe9d24-8dbf-42fc-b305-e7c0a2bb8bb2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:52.304402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aabe9d24-8dbf-42fc-b305-e7c0a2bb8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:52.424552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 824/1657] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:52.468960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:52.469913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:52.587811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1feec-0580-4947-8299-4542ff81fc34 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:52.596014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836056ab-f1ec-4450-b84d-06c71d36ca54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:52.597682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836056ab-f1ec-4450-b84d-06c71d36ca54 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:52.598462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836056ab-f1ec-4450-b84d-06c71d36ca54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:52.599246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836056ab-f1ec-4450-b84d-06c71d36ca54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:52.614106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836056ab-f1ec-4450-b84d-06c71d36ca54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:52.615863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836056ab-f1ec-4450-b84d-06c71d36ca54 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:52.631254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 834/1658] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:53.112644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68612576-a96f-418a-bacf-9944835bc508 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:53.113224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68612576-a96f-418a-bacf-9944835bc508 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:53.113665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68612576-a96f-418a-bacf-9944835bc508 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:53.116646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 825/1659] 10.222.0.84 () {54 vars in 912 bytes} [Fri May 13 18:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:26:53.128391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:53.129248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:53.129699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:53.227363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:53.230749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:53.261174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 835/1660] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:53.286818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68612576-a96f-418a-bacf-9944835bc508 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:53.342355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68612576-a96f-418a-bacf-9944835bc508 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:53.349972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:53.350776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:53.351165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:53.351539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:53.377944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:53.382896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:53.408177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 826/1661] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:54.145154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:54.147573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:54.187187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2768a12-8b51-4aa0-bb3b-65dcf17ee547 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:54.203379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:54.205563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:54.207552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:54.208420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] PATH_INFO: `/v3/projects/dccc59cf460f42e29c71e68a5ccf3f11` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:54.211224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccc59cf460f42e29c71e68a5ccf3f11)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:54.217913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:54.381599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccc59cf460f42e29c71e68a5ccf3f11', 'request_id': 'req-18a69194-9f95-49be-add7-a29400b30381'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.398545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccc59cf460f42e29c71e68a5ccf3f11', 'request_id': 'req-18a69194-9f95-49be-add7-a29400b30381'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.407116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccc59cf460f42e29c71e68a5ccf3f11', 'request_id': 'req-18a69194-9f95-49be-add7-a29400b30381'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.443256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] The token cache is being invalidate because project dccc59cf460f42e29c71e68a5ccf3f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:26:54.443982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.444928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.449022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 836/1662] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:26:54 2022] DELETE /identity/v3/projects/dccc59cf460f42e29c71e68a5ccf3f11 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:54.452661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:54.480554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ce73-585b-4ef9-b556-1dd8609a88c2 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:54.627871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:54.629006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:54.629393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:54.629777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] PATH_INFO: `/v3/users/65e146b517514b3f9b5bb832d298e854` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:54.633519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e146b517514b3f9b5bb832d298e854)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:54.637463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:54.784066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e146b517514b3f9b5bb832d298e854'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.784066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e146b517514b3f9b5bb832d298e854'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.801346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e146b517514b3f9b5bb832d298e854'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.819883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e146b517514b3f9b5bb832d298e854'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.822227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e146b517514b3f9b5bb832d298e854'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:54.856334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 827/1663] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:26:54 2022] DELETE /identity/v3/users/65e146b517514b3f9b5bb832d298e854 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:55.067166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:55.068738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:55.308544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69194-9f95-49be-add7-a29400b30381 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:55.468316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:55.468316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:55.468316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:55.468316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:55.473676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:55.499830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:55.501613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f490-a731-4c2c-905b-88aa48a61525 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:55.537641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 837/1664] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:56.252563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:56.254430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:56.426721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a152-fb53-4a55-aeef-0bb8bd46cc35 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:56.442062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:56.447277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:56.448010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:56.448434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] PATH_INFO: `/v3/projects/0aa1326b206d4906835ad3e49885dc56` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:56.450312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa1326b206d4906835ad3e49885dc56)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:56.452095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 18:26:56.452095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 13 18:26:56.452095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: May 13 18:26:56.454075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:56.599614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa1326b206d4906835ad3e49885dc56', 'request_id': 'req-302b1096-fbba-4cd8-a79d-c453e9e2f33b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:56.620829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa1326b206d4906835ad3e49885dc56', 'request_id': 'req-302b1096-fbba-4cd8-a79d-c453e9e2f33b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:56.642394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa1326b206d4906835ad3e49885dc56', 'request_id': 'req-302b1096-fbba-4cd8-a79d-c453e9e2f33b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:56.684286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] The token cache is being invalidate because project 0aa1326b206d4906835ad3e49885dc56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:26:56.684855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:56.685715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302b1096-fbba-4cd8-a79d-c453e9e2f33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:26:56.688178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 828/1665] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:26:56 2022] DELETE /identity/v3/projects/0aa1326b206d4906835ad3e49885dc56 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:56.694427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:56.695423 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:56.695916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:56.730897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:56.732127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:56.893198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 838/1666] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:26:56.902100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:56.902585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:56.903078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:56.932410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:56.935226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:56.951581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 829/1667] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:26:56.956231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:56.969469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ec2b8-90ed-409b-95d8-fc3e6e5441df None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:56.983400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:56.984800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:56.985286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:56.985847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.004277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:26:57.005739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:57.011077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:57.053991 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 839/1668] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:26:57.056007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:57.074142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ae9ad-a98a-4f96-88d3-f53792ed593e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:57.091560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:57.092313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.092662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.093002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.093845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:57.098987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:57.165584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 830/1669] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:57 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:57.169523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:57.201667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd86f74-e825-4a7a-818c-2b2c133b8c73 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:57.330127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:57.330826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.331115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.331433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.332144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:57.346646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:57.388688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 840/1670] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:57 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:57.389957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:57.428232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d9861-daaf-465e-96c2-ec9fba4fe6f3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:57.440408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:57.441228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.441519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.441876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.442554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:57.444150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:57.489839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:57.496665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 831/1671] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:57.515253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ee40-b669-46a8-9528-f9924e04fade admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:57.529026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138217f-8b7b-4cdd-a2ff-cb08ecc2a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:57.530927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138217f-8b7b-4cdd-a2ff-cb08ecc2a674 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.531040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138217f-8b7b-4cdd-a2ff-cb08ecc2a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.531212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138217f-8b7b-4cdd-a2ff-cb08ecc2a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.535250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138217f-8b7b-4cdd-a2ff-cb08ecc2a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:57.538267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138217f-8b7b-4cdd-a2ff-cb08ecc2a674 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:57.559662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 841/1672] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:57.564184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:57.580515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe7ed9-eec1-443e-9dd9-d43cec4998be admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:57.601056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a33da-af7d-4ae9-afd4-5bd5513bbeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:57.601986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a33da-af7d-4ae9-afd4-5bd5513bbeff admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.602269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a33da-af7d-4ae9-afd4-5bd5513bbeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.602584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a33da-af7d-4ae9-afd4-5bd5513bbeff admin admin] PATH_INFO: `/v3/projects/7aecf54a96f84aa8a9288d32051426ac/users/fb55f455338c44e3927a1453ed8773ed/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.642473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a33da-af7d-4ae9-afd4-5bd5513bbeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aecf54a96f84aa8a9288d32051426ac, user_id=fb55f455338c44e3927a1453ed8773ed, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:57.646277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a33da-af7d-4ae9-afd4-5bd5513bbeff admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:57.674474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.674790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.675408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.706323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 832/1673] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:57 2022] PUT /identity/v3/projects/7aecf54a96f84aa8a9288d32051426ac/users/fb55f455338c44e3927a1453ed8773ed/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:57.712149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:57.712962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:57.714327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:57.747045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] MFA Rules not processed for user `146368a389f94e2fbe6776bb27d60378`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:57.748255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:57.777084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] MFA Rules not processed for user `fb55f455338c44e3927a1453ed8773ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:57.779251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:57.946813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 842/1674] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:26:57.960908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:57.962638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:57.982326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 833/1675] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:57.987791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.102861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac3ef7-7165-4592-a1b4-79bf863c2d04 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.108299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.109274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.109725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.110423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.111343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.114393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.120808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d019-b87b-4872-97b3-45ed1bbf6c1d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.144738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.146593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.147455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.147994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.152643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 834/1676] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:26:57 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:58.156453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.168676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.173132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.197054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 843/1677] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:26:58.259683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2354c-f95e-4cfc-952b-3e53b63cb434 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.266080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.266911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.267506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.267851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.268628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.270738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.303468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 835/1678] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:26:58 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:26:58.308138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.338238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed15d8-7971-43b5-bff9-9a3d6519c7a9 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.347766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.348581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.348873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.349191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.350223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.381741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.409194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 844/1679] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:58.412387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.435653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601864-b924-473b-906b-eac3dd784eb5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.450031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.451121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.451501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.451983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] PATH_INFO: `/v3/projects/1dba65a4d1a84451a3045d8bfa02ea0e/users/2d8ea2f1964e4a73ac40cff2c765fccb/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.473234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dba65a4d1a84451a3045d8bfa02ea0e, user_id=2d8ea2f1964e4a73ac40cff2c765fccb, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.476474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.509421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 836/1680] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:58 2022] PUT /identity/v3/projects/1dba65a4d1a84451a3045d8bfa02ea0e/users/2d8ea2f1964e4a73ac40cff2c765fccb/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:58.513130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.526074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67ac38-d140-417b-81f8-d69413da0a53 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.663581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a999dfa-23d4-40a4-b24c-d2e49b168820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.664153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a999dfa-23d4-40a4-b24c-d2e49b168820 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.664921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a999dfa-23d4-40a4-b24c-d2e49b168820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.665376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a999dfa-23d4-40a4-b24c-d2e49b168820 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.666130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a999dfa-23d4-40a4-b24c-d2e49b168820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.667754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a999dfa-23d4-40a4-b24c-d2e49b168820 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.679579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 845/1681] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:26:58.684121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.702932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7745dd-1f3c-4932-8cce-e1226508a230 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:58.725963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:58.727127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.728123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.728574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] PATH_INFO: `/v3/projects/1dba65a4d1a84451a3045d8bfa02ea0e/users/2d8ea2f1964e4a73ac40cff2c765fccb/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.730850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dba65a4d1a84451a3045d8bfa02ea0e, user_id=2d8ea2f1964e4a73ac40cff2c765fccb, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:58.734239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:58.750455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 837/1682] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:26:58 2022] PUT /identity/v3/projects/1dba65a4d1a84451a3045d8bfa02ea0e/users/2d8ea2f1964e4a73ac40cff2c765fccb/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:26:58.762216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:58.762717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:58.762811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:58.819418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] MFA Rules not processed for user `2d8ea2f1964e4a73ac40cff2c765fccb`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:58.820626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:58.959803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 846/1683] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:26:58.974175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:58.976605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:59.097955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa2fb-e52b-4040-ab6f-4c4fa204fa76 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:59.103462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dcca-ae69-4bfd-94ea-9edcec4249c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:59.104402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dcca-ae69-4bfd-94ea-9edcec4249c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:59.104853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dcca-ae69-4bfd-94ea-9edcec4249c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:59.105311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dcca-ae69-4bfd-94ea-9edcec4249c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:59.121985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dcca-ae69-4bfd-94ea-9edcec4249c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:59.124610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dcca-ae69-4bfd-94ea-9edcec4249c7 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:59.143260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 838/1684] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:26:59.261266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:26:59.263136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:26:59.288006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a977e-4c4d-48d7-a332-2bef4d083ab5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:26:59.295648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:26:59.296644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:59.305934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:59.306556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:59.425725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:26:59.427305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:26:59.449066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 847/1685] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:26:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:26:59.797580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:26:59.798102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:26:59.798176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:26:59.879136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] MFA Rules not processed for user `57d481d6b7d641838ca9128d2a366702`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:26:59.880643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:00.035310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 839/1686] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:26:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:00.052091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:00.171536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac99bb-569c-404d-abd4-1382cadcffaa service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:00.179640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fa65a-2536-4c5d-9bfd-4e74ef2334be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:00.181076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fa65a-2536-4c5d-9bfd-4e74ef2334be service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:00.182163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fa65a-2536-4c5d-9bfd-4e74ef2334be service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:00.183242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fa65a-2536-4c5d-9bfd-4e74ef2334be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:00.201684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fa65a-2536-4c5d-9bfd-4e74ef2334be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:00.204096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fa65a-2536-4c5d-9bfd-4e74ef2334be service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:00.229930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 848/1687] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:00.814369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:00.818519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:01.021340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f96d-418d-4690-b0a7-29b28a739545 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:01.021635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f96d-418d-4690-b0a7-29b28a739545 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:01.022260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f96d-418d-4690-b0a7-29b28a739545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:01.063347 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-50e3f96d-418d-4690-b0a7-29b28a739545 None None] MFA Rules not processed for user `146368a389f94e2fbe6776bb27d60378`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:01.068621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-50e3f96d-418d-4690-b0a7-29b28a739545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:01.218497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbc146-8fa4-48aa-8897-bd136804db8a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:01.240118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:01.249424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 849/1688] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:01.249714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:01.249714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:01.249714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] PATH_INFO: `/v3/users/c7e0e02593ee4adaa804d0337e2f276d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:01.275556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e0e02593ee4adaa804d0337e2f276d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:01.277516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:01.401745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e0e02593ee4adaa804d0337e2f276d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:01.405059 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e0e02593ee4adaa804d0337e2f276d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:01.441853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e0e02593ee4adaa804d0337e2f276d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:01.456298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e0e02593ee4adaa804d0337e2f276d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:01.458190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e0e02593ee4adaa804d0337e2f276d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:01.486855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:01.487335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:01.487719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 840/1689] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:00 2022] DELETE /identity/v3/users/c7e0e02593ee4adaa804d0337e2f276d => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:01.487927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:01.537941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:01.541715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:01.770444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 850/1690] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:01.781244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:01.783170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:01.876755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f214-a927-48e0-a38a-dd60b40520e5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:01.883302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a02975-16fd-455f-bfa1-8068faab2d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:01.884591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02975-16fd-455f-bfa1-8068faab2d09 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:01.885131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02975-16fd-455f-bfa1-8068faab2d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:01.886013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02975-16fd-455f-bfa1-8068faab2d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:01.898510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a02975-16fd-455f-bfa1-8068faab2d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:01.915426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a02975-16fd-455f-bfa1-8068faab2d09 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:01.941279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 841/1691] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:02.396487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:02.398318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:02.425316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26e635-09f3-491a-b267-511654a1a7f2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:02.430511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:02.431907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:02.432197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:02.432477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] PATH_INFO: `/v3/projects/ee2bafc77fbe4de6b6081f3daaa458b6` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:02.438782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2bafc77fbe4de6b6081f3daaa458b6)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:02.440645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:02.512678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2bafc77fbe4de6b6081f3daaa458b6', 'request_id': 'req-88313cc0-7825-45a1-a500-52a0c2edea1e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:02.520069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2bafc77fbe4de6b6081f3daaa458b6', 'request_id': 'req-88313cc0-7825-45a1-a500-52a0c2edea1e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:02.527905 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2bafc77fbe4de6b6081f3daaa458b6', 'request_id': 'req-88313cc0-7825-45a1-a500-52a0c2edea1e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:02.544821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] The token cache is being invalidate because project ee2bafc77fbe4de6b6081f3daaa458b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:02.545119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:02.546281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-88313cc0-7825-45a1-a500-52a0c2edea1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:02.548003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 851/1692] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:02 2022] DELETE /identity/v3/projects/ee2bafc77fbe4de6b6081f3daaa458b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:02.553547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:02.554055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:02.554345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:02.575323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:02.576546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:02.664262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 842/1693] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:02.666651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:02.666975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:02.667081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:02.693669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:02.695363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:02.710211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:02.710726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 852/1694] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:02.724537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cc8b-6469-4c5d-9d1b-42a045ab72b1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:02.750093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:02.750954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:02.751400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:02.751823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:02.752781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:02.753241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:02.755721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:02.793293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 843/1695] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:02.797451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:02.815088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca7a0-1be9-46c6-bac2-cc9b63842587 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:02.822327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:02.823046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:02.823328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:02.823606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:02.824314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:02.829608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:02.900673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 853/1696] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:02 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:02.905179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:02.918983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e766-6d2a-4708-b086-9b41dd0b2f29 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:03.149706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:03.150963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.151686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.151986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.153121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:03.155372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:03.185583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 844/1697] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:02 2022] POST /identity/v3/users => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:03.192288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:03.207252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f02b6-d1b2-4590-bacc-a4b7b189beb4 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:03.212970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:03.213997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.214101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.214344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.215081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:03.216786 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:03.246794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 854/1698] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:03.251660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:03.265833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a9fbd-b142-4066-85f1-157991cae005 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:03.278941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d76a-2d33-49f8-89ba-e994f6666692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:03.279633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d76a-2d33-49f8-89ba-e994f6666692 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.279914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d76a-2d33-49f8-89ba-e994f6666692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.280204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d76a-2d33-49f8-89ba-e994f6666692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.280918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d76a-2d33-49f8-89ba-e994f6666692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:03.282546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d76a-2d33-49f8-89ba-e994f6666692 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:03.299098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 845/1699] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:03.302941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:03.321490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54395a3-9af6-4a9c-a7a3-e55aade58572 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:03.329111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:03.330418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.332226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.332679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] PATH_INFO: `/v3/projects/45692e8a0da14990b6ac83e70e3aed57/users/1ef8de3c466240658b78f7491bd36f03/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.357321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45692e8a0da14990b6ac83e70e3aed57, user_id=1ef8de3c466240658b78f7491bd36f03, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:03.362011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:03.379995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 855/1700] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:03 2022] PUT /identity/v3/projects/45692e8a0da14990b6ac83e70e3aed57/users/1ef8de3c466240658b78f7491bd36f03/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:03.385756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57593717-6120-40ae-a3d6-2a2aef889b80 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.386068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57593717-6120-40ae-a3d6-2a2aef889b80 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.386495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57593717-6120-40ae-a3d6-2a2aef889b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.418020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-57593717-6120-40ae-a3d6-2a2aef889b80 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:03.422938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-57593717-6120-40ae-a3d6-2a2aef889b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:03.517126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 846/1701] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:03.543316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:03.551945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:03.591277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ed82-6abd-4dbd-8f90-a5aa085b4932 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.591784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ed82-6abd-4dbd-8f90-a5aa085b4932 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.593258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ed82-6abd-4dbd-8f90-a5aa085b4932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.614951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f260ed82-6abd-4dbd-8f90-a5aa085b4932 None None] MFA Rules not processed for user `57d481d6b7d641838ca9128d2a366702`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:03.622497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f260ed82-6abd-4dbd-8f90-a5aa085b4932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:03.662032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a805-873b-4130-981f-ae0bcfd995f9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:03.666222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:03.667126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:03.667598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:03.668027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:03.686280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:03.687863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:03.713816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 856/1702] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:03.808422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 847/1703] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:04.014066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:04.016316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:04.049385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15833d4d-36da-474a-83b5-332e0606d9a2 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:04.075658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:04.076733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:04.078218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:04.078601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] PATH_INFO: `/v3/users/fb55f455338c44e3927a1453ed8773ed` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:04.083326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb55f455338c44e3927a1453ed8773ed)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:04.090750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:04.137173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:04.138238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:04.138666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:04.207992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:04.212732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:04.237737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb55f455338c44e3927a1453ed8773ed'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:04.247371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb55f455338c44e3927a1453ed8773ed'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:04.302574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb55f455338c44e3927a1453ed8773ed'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:04.315098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb55f455338c44e3927a1453ed8773ed'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:04.316530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f825841-d009-425a-9375-81ff500810a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb55f455338c44e3927a1453ed8773ed'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:04.368449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 857/1704] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:04 2022] DELETE /identity/v3/users/fb55f455338c44e3927a1453ed8773ed => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:04.378945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:04.379938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:04.380813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:04.398489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 848/1705] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:27:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:04.479097 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:04.481487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:04.643683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 858/1706] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:04.710176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:04.712218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:04.733637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ca99e-f9ae-43b5-8d4e-5511a378cd30 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:04.822941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:04.828882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:04.952203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590820a1-c58e-484b-a78e-82e53e2b12a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:04.952869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590820a1-c58e-484b-a78e-82e53e2b12a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:04.953152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590820a1-c58e-484b-a78e-82e53e2b12a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:04.953432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590820a1-c58e-484b-a78e-82e53e2b12a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:04.985263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590820a1-c58e-484b-a78e-82e53e2b12a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:04.986838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590820a1-c58e-484b-a78e-82e53e2b12a0 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:05.020131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 849/1707] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:05.063907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e916446-5fa5-4435-a95b-a141616472cd None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:05.079753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c77e73-8d4f-41d6-b326-602d81ba8e94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:05.080432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77e73-8d4f-41d6-b326-602d81ba8e94 service swift] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:05.080789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77e73-8d4f-41d6-b326-602d81ba8e94 service swift] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:05.081003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77e73-8d4f-41d6-b326-602d81ba8e94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:05.308432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c77e73-8d4f-41d6-b326-602d81ba8e94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:05.310211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c77e73-8d4f-41d6-b326-602d81ba8e94 service swift] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:05.345749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 859/1708] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:27:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:27:05.402076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6375-1f89-46cb-b66f-08891660fcb7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:05.402955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6375-1f89-46cb-b66f-08891660fcb7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:05.403981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6375-1f89-46cb-b66f-08891660fcb7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:05.406113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 850/1709] 10.222.0.84 () {54 vars in 912 bytes} [Fri May 13 18:27:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:27:05.415341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:05.415957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:05.416584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:05.464806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:05.469696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:05.490594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 860/1710] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:27:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:05.748995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6375-1f89-46cb-b66f-08891660fcb7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:05.751558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fd2b6375-1f89-46cb-b66f-08891660fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:05.781712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6375-1f89-46cb-b66f-08891660fcb7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:05.791975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfa343-75a4-4b33-9ad5-eb4c3f816d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:05.794505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa343-75a4-4b33-9ad5-eb4c3f816d9e service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:05.795160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa343-75a4-4b33-9ad5-eb4c3f816d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:05.795504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa343-75a4-4b33-9ad5-eb4c3f816d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:05.814486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa343-75a4-4b33-9ad5-eb4c3f816d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:05.817023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa343-75a4-4b33-9ad5-eb4c3f816d9e service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:05.847369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 851/1711] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:06.730093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:06.731354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:06.767330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b6be-250a-4594-b70f-dc1e62ca1b75 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:06.788096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:06.788438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:06.788715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:06.788989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] PATH_INFO: `/v3/users/20bc6ed6c7cb4aff9e19d65e652043bd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:06.790622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bc6ed6c7cb4aff9e19d65e652043bd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:06.792732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:06.814739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:06.815233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:06.815326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:06.925742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] MFA Rules not processed for user `1ef8de3c466240658b78f7491bd36f03`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:06.932213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:06.981769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bc6ed6c7cb4aff9e19d65e652043bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:06.982806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bc6ed6c7cb4aff9e19d65e652043bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.021275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bc6ed6c7cb4aff9e19d65e652043bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.043700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bc6ed6c7cb4aff9e19d65e652043bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.047804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-94724dde-5d94-4937-b641-e8b48b59ae4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bc6ed6c7cb4aff9e19d65e652043bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.093664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 861/1712] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:06 2022] DELETE /identity/v3/users/20bc6ed6c7cb4aff9e19d65e652043bd => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:07.098745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:07.099054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:07.099442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:07.171279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:07.172719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:07.184694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 852/1713] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:07.185917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:07.187434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:07.218291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe87-2dd0-4038-a8ae-cd2bbe55381e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:07.331967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 862/1714] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:07.333398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:07.339421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:07.359788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:07.361548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:07.362472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:07.363211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] PATH_INFO: `/v3/projects/7aecf54a96f84aa8a9288d32051426ac` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:07.365334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aecf54a96f84aa8a9288d32051426ac)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:07.369297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:07.391780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab4fb6-9c55-4a17-bbce-c60acf963783 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:07.414796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903528df-3144-444d-a18d-901b46744423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:07.416702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903528df-3144-444d-a18d-901b46744423 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:07.417066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903528df-3144-444d-a18d-901b46744423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:07.417421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903528df-3144-444d-a18d-901b46744423 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:07.422160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903528df-3144-444d-a18d-901b46744423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:07.434750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903528df-3144-444d-a18d-901b46744423 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:07.441475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aecf54a96f84aa8a9288d32051426ac', 'request_id': 'req-42f602ae-f246-483b-ae6c-545fa478740b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.451410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aecf54a96f84aa8a9288d32051426ac', 'request_id': 'req-42f602ae-f246-483b-ae6c-545fa478740b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.458932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aecf54a96f84aa8a9288d32051426ac', 'request_id': 'req-42f602ae-f246-483b-ae6c-545fa478740b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.485024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] The token cache is being invalidate because project 7aecf54a96f84aa8a9288d32051426ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:07.487967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.489933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:07.498152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 853/1715] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:07 2022] DELETE /identity/v3/projects/7aecf54a96f84aa8a9288d32051426ac => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:07.499724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:07.504211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:07.568188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 863/1716] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:07 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:07.584245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903528df-3144-444d-a18d-901b46744423 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:07.590746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-903528df-3144-444d-a18d-901b46744423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:07.746763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f602ae-f246-483b-ae6c-545fa478740b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:07.812126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903528df-3144-444d-a18d-901b46744423 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:07.842635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:07.843559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:07.843847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:07.844122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] PATH_INFO: `/v3/users/2d8ea2f1964e4a73ac40cff2c765fccb` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:07.847410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8ea2f1964e4a73ac40cff2c765fccb)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:07.849678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.039304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:08.044682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.046338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8ea2f1964e4a73ac40cff2c765fccb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.050202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8ea2f1964e4a73ac40cff2c765fccb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.058631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.060233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.064304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.095445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8ea2f1964e4a73ac40cff2c765fccb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.124378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8ea2f1964e4a73ac40cff2c765fccb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.130189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8ea2f1964e4a73ac40cff2c765fccb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.136215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:08.140456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd00c2-865d-475d-a9f6-619545d3b7b6 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.167580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 864/1717] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:07 2022] DELETE /identity/v3/users/2d8ea2f1964e4a73ac40cff2c765fccb => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:08.171482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:08.176014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.188863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 854/1718] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:08.191693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.192086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.192467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.256164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:08.281435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.344048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16a22-9205-4b7d-86de-91feb4d5d1e3 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:08.349326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:08.350274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.350704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.351150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.352833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:08.355050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.418145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 865/1719] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:08 2022] POST /identity/v3/users => generated 309 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:08.421944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:08.450590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bdb8a-5914-43dc-a2a6-62aa8fb240be admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:08.466381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:08.467052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 855/1720] 10.222.0.13 () {58 vars in 1015 bytes} [Fri May 13 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:08.467645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.468178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.468654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.469687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:08.470913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:08.472353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.472666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.497362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 866/1721] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:08.517024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:08.520240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99d57-2044-4f16-9e73-34bf26b31eb3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:08.534957 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:08.538339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.539579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.540823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] PATH_INFO: `/v3/users/b8f4c6fecee64ac493b200f7e06ca61a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.544629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f4c6fecee64ac493b200f7e06ca61a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:08.546969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db271f0-5f6e-4717-9c62-dce6af74f22e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:08.553415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.582777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:08.583738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.584029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.584425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] PATH_INFO: `/v3/projects/1be68fce524c40108a40284a8a011dac/users/479d34fe2bda4b7ea7e1e7292d4596cf/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.635352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be68fce524c40108a40284a8a011dac, user_id=479d34fe2bda4b7ea7e1e7292d4596cf, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:08.638046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.677004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 867/1722] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:08 2022] PUT /identity/v3/projects/1be68fce524c40108a40284a8a011dac/users/479d34fe2bda4b7ea7e1e7292d4596cf/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:08.677004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:08.686961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.762425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f4c6fecee64ac493b200f7e06ca61a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.765548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f4c6fecee64ac493b200f7e06ca61a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.799410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f4c6fecee64ac493b200f7e06ca61a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.821345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f4c6fecee64ac493b200f7e06ca61a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.825687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7781545-8ce9-49f6-b9ca-6ebf8b4f620f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:08.827682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f4c6fecee64ac493b200f7e06ca61a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:08.830636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:08.831318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.831759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.832045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.835628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.856091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:08.858068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 856/1723] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:08 2022] DELETE /identity/v3/users/b8f4c6fecee64ac493b200f7e06ca61a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:08.861298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:08.861637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fc797-8101-458d-8c0b-223b8a833af5 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:08.865774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:08.878287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 868/1724] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:08.879631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:08.879931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:08.880668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:08.907309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:08.909007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:09.034655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 869/1725] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:09.058226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:09.059948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:09.120510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4b0d-03be-4fef-82c8-9e78c1e91aea admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:09.141660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:09.142469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:09.147054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:09.147408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:09.148312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:09.152502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:09.192204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 857/1726] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:09.198669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:09.227651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d1270-5b46-4bac-ad36-e9aecb341312 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:09.234549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:09.235235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:09.235521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:09.235945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:09.243203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a48cd-f338-4f32-9d09-ac4912da38b9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:09.254585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:09.255629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb2f28-0d7c-43cf-bf19-b889edf1afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:09.256115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:09.256747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb2f28-0d7c-43cf-bf19-b889edf1afd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:09.257025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb2f28-0d7c-43cf-bf19-b889edf1afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:09.257302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb2f28-0d7c-43cf-bf19-b889edf1afd0 admin admin] PATH_INFO: `/v3/projects/1be68fce524c40108a40284a8a011dac/users/479d34fe2bda4b7ea7e1e7292d4596cf/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:09.283707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb2f28-0d7c-43cf-bf19-b889edf1afd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be68fce524c40108a40284a8a011dac, user_id=479d34fe2bda4b7ea7e1e7292d4596cf, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:09.290544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 870/1727] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:09.292155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb2f28-0d7c-43cf-bf19-b889edf1afd0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:09.352972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 858/1728] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:09 2022] PUT /identity/v3/projects/1be68fce524c40108a40284a8a011dac/users/479d34fe2bda4b7ea7e1e7292d4596cf/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:09.514040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:09.515471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:09.537542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859ae7-58ed-4d54-ac77-1cf164507cfe service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:09.758705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:09.759986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:09.760417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:09.760849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] PATH_INFO: `/v3/projects/912db730eef84d22b00456e1623401a4` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:09.777872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=912db730eef84d22b00456e1623401a4)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:09.781878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:09.907891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912db730eef84d22b00456e1623401a4', 'request_id': 'req-bee03cc5-e076-453f-a28b-bd8de257fa9f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:09.915747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912db730eef84d22b00456e1623401a4', 'request_id': 'req-bee03cc5-e076-453f-a28b-bd8de257fa9f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:09.922770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912db730eef84d22b00456e1623401a4', 'request_id': 'req-bee03cc5-e076-453f-a28b-bd8de257fa9f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:09.949070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] The token cache is being invalidate because project 912db730eef84d22b00456e1623401a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:09.950437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:09.954445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bee03cc5-e076-453f-a28b-bd8de257fa9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:09.956902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 871/1729] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:09 2022] DELETE /identity/v3/projects/912db730eef84d22b00456e1623401a4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:09.966787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:09.967804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:09.968306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:10.060806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:10.070675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:10.279116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 859/1730] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:10.291645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:10.292856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:10.294569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:10.430546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:10.430546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:10.451225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 872/1731] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:10.454773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:10.472987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847b96f-2dda-4af7-89c8-6f74f79b754a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:10.490516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:10.494095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:10.494827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:10.497059 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:10.497935 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:10.498119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:10.500041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:10.569900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 860/1732] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:10.575285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:10.592453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644a649-c964-4655-aa48-14c8d382edf6 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:10.615398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:10.616136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:10.619242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:10.619671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:10.621585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:10.627987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:10.734336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 873/1733] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:10 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:10.735647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:10.753618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a8c55-406b-41fc-8aa5-c2c23a0442ed admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:10.953740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:10.954479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:10.954762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:10.955059 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:10.955742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:10.959114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:11.047693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 861/1734] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:10 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:11.051838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:11.072674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee0deb-e84b-4da2-8699-20158913b6c6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:11.087519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:11.088322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:11.088562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:11.091210 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:11.093469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:11.098021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:11.139992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 874/1735] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:11.140790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:11.155162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac59775-03ad-4c35-988f-20b9f4f9e32b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:11.170094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03956958-cac6-4022-8746-b815c86d99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:11.172219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956958-cac6-4022-8746-b815c86d99cb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:11.172781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956958-cac6-4022-8746-b815c86d99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:11.173496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956958-cac6-4022-8746-b815c86d99cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:11.176301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03956958-cac6-4022-8746-b815c86d99cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:11.180052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03956958-cac6-4022-8746-b815c86d99cb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:11.209556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 862/1736] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:11.213211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:11.235339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b5ba-b33c-48a1-8eca-fa7cdb6e54ef admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:11.267903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:11.270319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:11.270649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:11.270935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] PATH_INFO: `/v3/projects/b8a4cb84f9e447b4bbe2f2fa4ae1cd35/users/b1074771f31844869bb8e7264e761ca8/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:11.315716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a4cb84f9e447b4bbe2f2fa4ae1cd35, user_id=b1074771f31844869bb8e7264e761ca8, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:11.323145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:11.350645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 875/1737] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:11 2022] PUT /identity/v3/projects/b8a4cb84f9e447b4bbe2f2fa4ae1cd35/users/b1074771f31844869bb8e7264e761ca8/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:11.362152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:11.362730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:11.362730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:11.417735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] MFA Rules not processed for user `b1074771f31844869bb8e7264e761ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:11.419385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:11.600509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 863/1738] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:11.606010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:11.843505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb6793-e958-40d0-8187-effaaee9b132 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:11.862973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:11.863458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:11.863745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:11.864020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:11.864693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:11.865636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:11.867109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:11.868627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:11.917670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89955-a6e5-4984-ae0e-2fe36b147e8f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:11.954060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 876/1739] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:11 2022] POST /identity/v3/projects => generated 365 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:11.958901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:11.965677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:11.966808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:11.967161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:11.967412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] PATH_INFO: `/v3/projects/8db17b57b02d441ab3b1c031153f6504` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:11.974474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db17b57b02d441ab3b1c031153f6504)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:11.982546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:12.099455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db17b57b02d441ab3b1c031153f6504', 'request_id': 'req-07ae35d2-52ab-41cc-a698-25d667c47403'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.107668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db17b57b02d441ab3b1c031153f6504', 'request_id': 'req-07ae35d2-52ab-41cc-a698-25d667c47403'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.115187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db17b57b02d441ab3b1c031153f6504', 'request_id': 'req-07ae35d2-52ab-41cc-a698-25d667c47403'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.158955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] The token cache is being invalidate because project 8db17b57b02d441ab3b1c031153f6504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:12.159558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.160607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.162886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 864/1740] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:11 2022] DELETE /identity/v3/projects/8db17b57b02d441ab3b1c031153f6504 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:12.190848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:12.200039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:12.268762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5338-1d0e-4981-9a4d-c79f8fe9fcd2 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:12.406551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae35d2-52ab-41cc-a698-25d667c47403 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:12.418602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:12.421514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:12.422576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:12.423239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] PATH_INFO: `/v3/users/50602c4e4f14494ebc3b5dbdb3c09fb1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:12.428678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50602c4e4f14494ebc3b5dbdb3c09fb1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:12.433999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:12.453424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:12.454445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:12.456678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:12.457196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:12.458230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:12.464024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:12.520289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 877/1741] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:11 2022] POST /identity/v3/users => generated 289 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:12.528252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:12.534911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:12.556925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50602c4e4f14494ebc3b5dbdb3c09fb1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.558275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50602c4e4f14494ebc3b5dbdb3c09fb1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.580421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059bfce-685d-4218-b590-09c2fe6dc189 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:12.591606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:12.593705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:12.595361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:12.595769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:12.596641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:12.599395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:12.599599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50602c4e4f14494ebc3b5dbdb3c09fb1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.615707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50602c4e4f14494ebc3b5dbdb3c09fb1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.621103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50602c4e4f14494ebc3b5dbdb3c09fb1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:12.629133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 878/1742] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:12.638353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:12.649205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 865/1743] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:12 2022] DELETE /identity/v3/users/50602c4e4f14494ebc3b5dbdb3c09fb1 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:12.649394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:12.677883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357d6d-67dd-41d3-a091-f287a00d5921 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:12.767375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:12.769281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:12.769732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:12.770274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] PATH_INFO: `/v3/projects/64c5cbafa1db49e4ac9d45d03f5fe624/users/417886f47d924ef1a906ff25d7114022/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:12.782622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:12.784271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:12.794359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c5cbafa1db49e4ac9d45d03f5fe624, user_id=417886f47d924ef1a906ff25d7114022, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:12.797506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:12.828382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5bf96-dd96-4bf8-bdec-1959c7c0bde1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:12.829982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 879/1744] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:12 2022] PUT /identity/v3/projects/64c5cbafa1db49e4ac9d45d03f5fe624/users/417886f47d924ef1a906ff25d7114022/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:12.834727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:12.988360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:12.989451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:12.993085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:12.993448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] PATH_INFO: `/v3/projects/1dba65a4d1a84451a3045d8bfa02ea0e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.000984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dba65a4d1a84451a3045d8bfa02ea0e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:13.006228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:13.020502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d568999-de33-4cba-abbd-0b820c43f8e2 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:13.040968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:13.051760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.052525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.054464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.057962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:13.062333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:13.099699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 880/1745] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:13.103682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:13.127851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177192-add0-4397-a9fd-04c49401a2fe admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:13.148177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dba65a4d1a84451a3045d8bfa02ea0e', 'request_id': 'req-caf22ed4-4346-424c-894e-1efab2142f55'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:13.165416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dba65a4d1a84451a3045d8bfa02ea0e', 'request_id': 'req-caf22ed4-4346-424c-894e-1efab2142f55'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:13.200190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dba65a4d1a84451a3045d8bfa02ea0e', 'request_id': 'req-caf22ed4-4346-424c-894e-1efab2142f55'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:13.241601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] The token cache is being invalidate because project 1dba65a4d1a84451a3045d8bfa02ea0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:13.242980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:13.244799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-caf22ed4-4346-424c-894e-1efab2142f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:13.253430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 866/1746] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:12 2022] DELETE /identity/v3/projects/1dba65a4d1a84451a3045d8bfa02ea0e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:13.255022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205f794-8b8f-43d2-8c07-bbcd453c5672 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.262237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205f794-8b8f-43d2-8c07-bbcd453c5672 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.263430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205f794-8b8f-43d2-8c07-bbcd453c5672 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.266703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 867/1747] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:27:13 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:27:13.280315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96044-5d53-4a98-8c71-ddbff215c0c2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.280623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96044-5d53-4a98-8c71-ddbff215c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.280905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96044-5d53-4a98-8c71-ddbff215c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.282608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f174e1-ad57-45d0-bd4b-7eef3e47598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:13.283539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f174e1-ad57-45d0-bd4b-7eef3e47598f admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.283825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f174e1-ad57-45d0-bd4b-7eef3e47598f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.294923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f174e1-ad57-45d0-bd4b-7eef3e47598f admin admin] PATH_INFO: `/v3/projects/64c5cbafa1db49e4ac9d45d03f5fe624/users/417886f47d924ef1a906ff25d7114022/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.302104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f174e1-ad57-45d0-bd4b-7eef3e47598f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c5cbafa1db49e4ac9d45d03f5fe624, user_id=417886f47d924ef1a906ff25d7114022, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:13.311095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f174e1-ad57-45d0-bd4b-7eef3e47598f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:13.344616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-58c96044-5d53-4a98-8c71-ddbff215c0c2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:13.345062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 881/1748] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:13 2022] PUT /identity/v3/projects/64c5cbafa1db49e4ac9d45d03f5fe624/users/417886f47d924ef1a906ff25d7114022/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:13.346854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-58c96044-5d53-4a98-8c71-ddbff215c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:13.348565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec037d6-8c3c-4e4e-9280-a85de3800a04 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.348858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec037d6-8c3c-4e4e-9280-a85de3800a04 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.349138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec037d6-8c3c-4e4e-9280-a85de3800a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.417847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fec037d6-8c3c-4e4e-9280-a85de3800a04 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:13.417847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fec037d6-8c3c-4e4e-9280-a85de3800a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:13.509658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 868/1749] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:13.509658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.509658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.513430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.563704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] MFA Rules not processed for user `417886f47d924ef1a906ff25d7114022`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:13.565519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:13.620114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 882/1750] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:13.623843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.624154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.625674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.672782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:13.674164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:13.697013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 883/1751] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:13.700682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:13.718688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 869/1752] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:13.722404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f5448-009e-43fc-97d0-faed340663cc None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:13.735895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:13.740120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:13.740579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:13.742063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.742772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.743342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.744663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:13.745364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:13.747998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:13.775768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 884/1753] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:13.780225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:13.792698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902ac1-201e-43a0-b0e3-e144d43cf608 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:13.798741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:13.800213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:13.800713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:13.801446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:13.803148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:13.805789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:13.855371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 885/1754] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:13.862275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:13.885029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a900a-3a25-43db-8b75-e9a895da94ea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.103280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2fa4-492a-4269-99e8-f1801d4271bd admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.115333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.116173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.116689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.117020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.118744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.120793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:14.130997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.135299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.139870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.142179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.192487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 886/1755] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:13 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:14.192487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:14.197942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.242109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde38bd-6ce1-48db-83ab-fc0a1622f479 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.261860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.265703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.265703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.265955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] PATH_INFO: `/v3/projects/5397beb9a41949d78823c8d30bb37f23` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.278450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5397beb9a41949d78823c8d30bb37f23)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.281837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:14.335033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.336638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:14.370853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 870/1756] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:14.372582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:14.400377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5397beb9a41949d78823c8d30bb37f23', 'request_id': 'req-add55cbe-7739-4de6-a3cf-d6034e5653f6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:14.403399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73897-3a1b-4647-881d-7a70afd5474e service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.410144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5397beb9a41949d78823c8d30bb37f23', 'request_id': 'req-add55cbe-7739-4de6-a3cf-d6034e5653f6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:14.425085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5397beb9a41949d78823c8d30bb37f23', 'request_id': 'req-add55cbe-7739-4de6-a3cf-d6034e5653f6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:14.447701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] The token cache is being invalidate because project 5397beb9a41949d78823c8d30bb37f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:14.448497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:14.450039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:14.454643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 887/1757] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:14 2022] DELETE /identity/v3/projects/5397beb9a41949d78823c8d30bb37f23 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:14.467296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:14.470960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.560421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64d0c-69e6-4dda-83ad-75866801f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.562097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64d0c-69e6-4dda-83ad-75866801f4ca admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.562718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64d0c-69e6-4dda-83ad-75866801f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.563233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64d0c-69e6-4dda-83ad-75866801f4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.564290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f64d0c-69e6-4dda-83ad-75866801f4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.567172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f64d0c-69e6-4dda-83ad-75866801f4ca admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:14.582988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add55cbe-7739-4de6-a3cf-d6034e5653f6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.587273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 871/1758] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:14.589288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.589991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.590603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.598787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.600024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.600024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.600403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.604521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.615564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:14.618499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.628365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 872/1759] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:14.629709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:14.631436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.639693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.641992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:14.663080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 888/1760] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:14.685963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:14.689369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.729489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb3bf6-9dce-4c30-923a-d1ac6b933318 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.731830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5645-0593-4dfd-9595-a9d5e94e735d service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.760423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.765718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.766101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.766423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.769850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4422b6-22c7-4b25-96c8-1199c8762fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.774502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4422b6-22c7-4b25-96c8-1199c8762fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.774502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4422b6-22c7-4b25-96c8-1199c8762fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.774914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4422b6-22c7-4b25-96c8-1199c8762fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.776427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4422b6-22c7-4b25-96c8-1199c8762fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.777638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.785779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4422b6-22c7-4b25-96c8-1199c8762fbe admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:14.839525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 889/1761] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:14.841102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.841369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.841641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.906244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:14.907500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:14.939793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 890/1762] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:14.940705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:14.952953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eda38-43bc-4ecd-8c5d-c06e814dfa06 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:14.958087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b92997-f4a8-45ad-868a-1cb22d548452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:14.959744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b92997-f4a8-45ad-868a-1cb22d548452 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:14.960060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b92997-f4a8-45ad-868a-1cb22d548452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:14.960618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b92997-f4a8-45ad-868a-1cb22d548452 admin admin] PATH_INFO: `/v3/projects/b91fdca8eb484a9a87df5977387d324c/users/e9de04207e9d4ce6a3b5a2ddbd09b685/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:14.989692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b92997-f4a8-45ad-868a-1cb22d548452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91fdca8eb484a9a87df5977387d324c, user_id=e9de04207e9d4ce6a3b5a2ddbd09b685, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:14.995026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b92997-f4a8-45ad-868a-1cb22d548452 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.020525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 891/1763] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:14 2022] PUT /identity/v3/projects/b91fdca8eb484a9a87df5977387d324c/users/e9de04207e9d4ce6a3b5a2ddbd09b685/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:15.021716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66419625-9acf-44f5-97a5-018311562cdc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.023106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66419625-9acf-44f5-97a5-018311562cdc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.023405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66419625-9acf-44f5-97a5-018311562cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.033534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:15.038106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.085173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-66419625-9acf-44f5-97a5-018311562cdc None None] MFA Rules not processed for user `479d34fe2bda4b7ea7e1e7292d4596cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:15.087363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-66419625-9acf-44f5-97a5-018311562cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:15.095135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 873/1764] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:15.108380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.187948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625b76-5576-4add-9e41-d76ac49244f7 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:15.339461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 892/1765] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:15.352996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.353253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.353477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.444512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:15.450101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:15.516607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:15.517304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.517616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.518334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.518648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:15.518963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:15.530465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.566218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 874/1766] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:15.574530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.599636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788ad0-4b9f-4b84-b492-b00f30b291d8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:15.612154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:15.614744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.615036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.616148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.618651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:15.624523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.648193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 893/1767] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:15.680657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 875/1768] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:15 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:15.684201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.705457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3b8e-7e16-4b4e-b97f-73494681ab1b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:15.799864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:15.800796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.801272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.801920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.803052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:15.807201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.836312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.839743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:15.863965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 894/1769] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:15 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:15.874207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.888496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fac5e-6c8c-481a-adfb-db962619cb4e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:15.893871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:15.894588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.894875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.895152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.895896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:15.897846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.914920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 895/1770] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:15.918818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.931216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d799850-c631-49d8-97cb-7171bf052059 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:15.936616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:15.937357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.937643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.937972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:15.938708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:15.940719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:15.958960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 896/1771] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:15.960428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:15.972462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f838569-96b2-42e3-a383-10fa751e183d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:15.980199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec2d0-581b-45d6-9a49-8538047a7b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:15.982291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec2d0-581b-45d6-9a49-8538047a7b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:15.982291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec2d0-581b-45d6-9a49-8538047a7b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:15.983284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec2d0-581b-45d6-9a49-8538047a7b6a admin admin] PATH_INFO: `/v3/projects/8f16d73ec9ef4c41bee1d41fac242f7b/users/f5bcb5d9afcd4aa0b2dab3e62cbe442f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.006068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec2d0-581b-45d6-9a49-8538047a7b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f16d73ec9ef4c41bee1d41fac242f7b, user_id=f5bcb5d9afcd4aa0b2dab3e62cbe442f, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:16.009624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec2d0-581b-45d6-9a49-8538047a7b6a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:16.044241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 897/1772] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:15 2022] PUT /identity/v3/projects/8f16d73ec9ef4c41bee1d41fac242f7b/users/f5bcb5d9afcd4aa0b2dab3e62cbe442f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:16.046373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.046735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.047055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.086553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] MFA Rules not processed for user `f5bcb5d9afcd4aa0b2dab3e62cbe442f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:16.087912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:16.110622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424043-5ccf-4d6d-9967-e38e91befc02 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:16.222275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 898/1773] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:16.228622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:16.274579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ade62a-e2ac-45f0-bf8a-b59eee7170f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:16.279171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ade62a-e2ac-45f0-bf8a-b59eee7170f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.279171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ade62a-e2ac-45f0-bf8a-b59eee7170f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.279171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ade62a-e2ac-45f0-bf8a-b59eee7170f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.404583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804dc17-df54-458e-b87c-76940830e6ab None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:16.418657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:16.419647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.420074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.422188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.423461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:16.427221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:16.489421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 899/1774] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:16 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:16.490990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:16.528191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ade62a-e2ac-45f0-bf8a-b59eee7170f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:16.537588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ade62a-e2ac-45f0-bf8a-b59eee7170f5 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:16.580153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2793f2-877d-49e9-882c-72bfb4d0ede0 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:16.590221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 876/1775] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:16.592231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11d7b-f86e-498f-a20e-d042f511b89e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.595686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11d7b-f86e-498f-a20e-d042f511b89e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.596316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11d7b-f86e-498f-a20e-d042f511b89e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.603202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 877/1776] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:27:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:27:16.603373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1b523-5ce2-4fb7-adf6-a893ab927e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:16.604346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1b523-5ce2-4fb7-adf6-a893ab927e81 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.604346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1b523-5ce2-4fb7-adf6-a893ab927e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.604624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1b523-5ce2-4fb7-adf6-a893ab927e81 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.605331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1b523-5ce2-4fb7-adf6-a893ab927e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:16.613539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1b523-5ce2-4fb7-adf6-a893ab927e81 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:16.691865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 900/1777] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:16 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:16.692328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11d7b-f86e-498f-a20e-d042f511b89e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:16.725207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11d7b-f86e-498f-a20e-d042f511b89e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:16.737382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.738537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.738790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.750609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:16.751297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.751584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.751865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.752609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:16.754243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:16.778839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 878/1778] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:16.782603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:16.790495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:16.800115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec435ee-e39c-423d-b389-31d0e7264165 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:16.801748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:16.809307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:16.811368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:16.812018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:16.813030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] PATH_INFO: `/v3/projects/3d94f2fc77a14bf0b8035856c6a90065/users/8facc7f857c54d11aad88fff9d0512a5/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:16.858857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d94f2fc77a14bf0b8035856c6a90065, user_id=8facc7f857c54d11aad88fff9d0512a5, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:16.866711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:16.950449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 879/1779] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:16 2022] PUT /identity/v3/projects/3d94f2fc77a14bf0b8035856c6a90065/users/8facc7f857c54d11aad88fff9d0512a5/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:16.968792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 901/1780] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:16.993636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:17.239002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f48b8-f60d-4213-8144-4f462944bdff admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:17.248085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a848-48b8-464a-ab69-44a87f2ca2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:17.249096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a848-48b8-464a-ab69-44a87f2ca2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:17.249446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a848-48b8-464a-ab69-44a87f2ca2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:17.249852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a848-48b8-464a-ab69-44a87f2ca2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:17.250732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a848-48b8-464a-ab69-44a87f2ca2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:17.261464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a848-48b8-464a-ab69-44a87f2ca2c7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:17.296884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 880/1781] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:17.300535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:17.325643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83918bed-0184-4269-80a4-ae2b23298ad0 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:17.344707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:17.347525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:17.348235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:17.349322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] PATH_INFO: `/v3/projects/3d94f2fc77a14bf0b8035856c6a90065/users/8facc7f857c54d11aad88fff9d0512a5/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:17.364785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d94f2fc77a14bf0b8035856c6a90065, user_id=8facc7f857c54d11aad88fff9d0512a5, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:17.372802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:17.422881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 902/1782] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:17 2022] PUT /identity/v3/projects/3d94f2fc77a14bf0b8035856c6a90065/users/8facc7f857c54d11aad88fff9d0512a5/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:17.434586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:17.434897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:17.435261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:17.512429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] MFA Rules not processed for user `8facc7f857c54d11aad88fff9d0512a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:17.517188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:17.638298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 881/1783] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:17.651448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:17.769021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1042-447d-42f9-a83c-3fc74b048fff admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:17.791103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb10f5-e31a-40d8-8733-8065a54615b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:17.792184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb10f5-e31a-40d8-8733-8065a54615b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:17.793769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb10f5-e31a-40d8-8733-8065a54615b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:17.795060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb10f5-e31a-40d8-8733-8065a54615b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:17.827713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb10f5-e31a-40d8-8733-8065a54615b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:17.829639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb10f5-e31a-40d8-8733-8065a54615b4 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:17.892803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 903/1784] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:17.904512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:17.906305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:18.059137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8c2fa-5e53-4197-aa5b-c8f9a5fc8743 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:18.074585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:18.075884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.078374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.083136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.107671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:18.109938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:18.124533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 882/1785] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:18.441704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.442064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.442306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.479558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] MFA Rules not processed for user `e9de04207e9d4ce6a3b5a2ddbd09b685`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:18.482133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:18.483688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:18.571000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c534f-a565-47d2-a584-ff898d5a9bba service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:18.580451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:18.582297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.582815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.584031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] PATH_INFO: `/v3/users/f5bcb5d9afcd4aa0b2dab3e62cbe442f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.587364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5bcb5d9afcd4aa0b2dab3e62cbe442f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:18.589895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:18.654239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 904/1786] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:18.659941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:18.689125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5bcb5d9afcd4aa0b2dab3e62cbe442f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:18.690418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5bcb5d9afcd4aa0b2dab3e62cbe442f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:18.699433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e3557-9917-49bf-aaab-5f60a1e3ac86 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:18.713514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:18.714230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.714530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.714792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.715616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:18.717559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:18.721227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5bcb5d9afcd4aa0b2dab3e62cbe442f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:18.731594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5bcb5d9afcd4aa0b2dab3e62cbe442f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:18.732864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5c095764-e61d-4134-b2d4-4f3b41a2f642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5bcb5d9afcd4aa0b2dab3e62cbe442f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:18.753859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 883/1787] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:18 2022] DELETE /identity/v3/users/f5bcb5d9afcd4aa0b2dab3e62cbe442f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:18.759916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.760308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.760729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.766001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 905/1788] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:18 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:18.768399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:18.771535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:18.787576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:18.789219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:18.864205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 884/1789] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:18.875876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:18.878952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:18.879528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbd449-7f04-4654-8b25-3d76dbd9c84e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:18.889350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:18.890332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.890783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.891309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.892833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:18.895282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:18.923867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 906/1790] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:18 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:18.928075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:18.940671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710fb43-0116-4477-9573-ff45ea5fef35 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:18.946978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:18.947845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.948223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.948592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:18.949557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:18.952219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:18.973329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 907/1791] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:18.979305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:18.991634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603ffd2-052b-4c4c-8e3d-efc70b64d697 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:18.997470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:18.998286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:18.998657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:18.999350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:19.012208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:19.013477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19245137-ca8b-4058-855b-c170784bb41f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:19.021248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:19.024706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:19.025616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:19.025947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:19.026225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] PATH_INFO: `/v3/projects/9a433d28c5874cdf9854d0e5692add98/users/2ecf8980d36e47b5ae46c83047f71aaf/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:19.082974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 885/1792] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:19.115861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a433d28c5874cdf9854d0e5692add98, user_id=2ecf8980d36e47b5ae46c83047f71aaf, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:19.123808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:19.157438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 908/1793] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:18 2022] PUT /identity/v3/projects/9a433d28c5874cdf9854d0e5692add98/users/2ecf8980d36e47b5ae46c83047f71aaf/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:19.160813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:19.176761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acaf89-5f23-4ed6-8852-1d1922886950 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:19.324746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:19.325433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:19.325712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:19.326014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:19.326760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:19.328784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:19.362111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 886/1794] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:19.364047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:19.382414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb6665-dfc4-4791-9b4a-8957e9533dc7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:19.398822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:19.399731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:19.400110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:19.400601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] PATH_INFO: `/v3/projects/9a433d28c5874cdf9854d0e5692add98/users/2ecf8980d36e47b5ae46c83047f71aaf/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:19.408847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a433d28c5874cdf9854d0e5692add98, user_id=2ecf8980d36e47b5ae46c83047f71aaf, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:19.412587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:19.425048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 909/1795] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:19 2022] PUT /identity/v3/projects/9a433d28c5874cdf9854d0e5692add98/users/2ecf8980d36e47b5ae46c83047f71aaf/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:20.050898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:20.052850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.069168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee315f-601b-49ee-a18e-0f00fd95d19c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:20.122529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:20.125454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.151469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:20.152792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:20.153238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:20.153679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] PATH_INFO: `/v3/projects/8f16d73ec9ef4c41bee1d41fac242f7b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:20.155010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f16d73ec9ef4c41bee1d41fac242f7b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:20.156924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:20.207061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d23cc-b0c6-4bd2-b401-55d71ad1b69a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:20.208301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f16d73ec9ef4c41bee1d41fac242f7b', 'request_id': 'req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.215725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f16d73ec9ef4c41bee1d41fac242f7b', 'request_id': 'req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.221865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f16d73ec9ef4c41bee1d41fac242f7b', 'request_id': 'req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.236954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] The token cache is being invalidate because project 8f16d73ec9ef4c41bee1d41fac242f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:20.237249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.237922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.240024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 887/1796] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:20 2022] DELETE /identity/v3/projects/8f16d73ec9ef4c41bee1d41fac242f7b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:20.244872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:20.246555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.296828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:20.297852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:20.298021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:20.298298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] PATH_INFO: `/v3/users/1ef8de3c466240658b78f7491bd36f03` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:20.300266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef8de3c466240658b78f7491bd36f03)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:20.302356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:20.335891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31cbc0-a33e-4e9a-a982-58e95cf52a9d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:20.341719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:20.343181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:20.343975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:20.344255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] PATH_INFO: `/v3/users/8facc7f857c54d11aad88fff9d0512a5` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:20.345915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8facc7f857c54d11aad88fff9d0512a5)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:20.347495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:20.366754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef8de3c466240658b78f7491bd36f03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.368416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef8de3c466240658b78f7491bd36f03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.389048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef8de3c466240658b78f7491bd36f03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.397191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef8de3c466240658b78f7491bd36f03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.399622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8facc7f857c54d11aad88fff9d0512a5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.400415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8facc7f857c54d11aad88fff9d0512a5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.401516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09608edd-1211-4c9f-9920-077d25a52af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef8de3c466240658b78f7491bd36f03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.417545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8facc7f857c54d11aad88fff9d0512a5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.423690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 910/1797] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:20 2022] DELETE /identity/v3/users/1ef8de3c466240658b78f7491bd36f03 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:20.425230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:20.425615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:20.426007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:20.427008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8facc7f857c54d11aad88fff9d0512a5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.428067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8facc7f857c54d11aad88fff9d0512a5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.455917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 888/1798] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:20 2022] DELETE /identity/v3/users/8facc7f857c54d11aad88fff9d0512a5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:20.470454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] MFA Rules not processed for user `2ecf8980d36e47b5ae46c83047f71aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:20.473987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.600908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 911/1799] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:20.608816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:20.610244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.678930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f2c3-c3b3-4e40-8f01-c72adb8086cf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:20.683418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:20.684151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:20.684992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:20.685510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:20.687525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.735145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:20.737158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.786207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:20.788155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:20.800481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 889/1800] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:20.871031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86736a00-5b1d-46c0-9e34-20db9ebd61b3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:20.876713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:20.877592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:20.877910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:20.878191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] PATH_INFO: `/v3/projects/45692e8a0da14990b6ac83e70e3aed57` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:20.879944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45692e8a0da14990b6ac83e70e3aed57)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:20.882949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:20.922095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:20.923523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:20.957970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e133e0-e074-47bb-a2ac-93d64cbb7929 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:20.975579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45692e8a0da14990b6ac83e70e3aed57', 'request_id': 'req-8aa8514a-c007-4e23-8a62-d07dd6701553'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.987465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45692e8a0da14990b6ac83e70e3aed57', 'request_id': 'req-8aa8514a-c007-4e23-8a62-d07dd6701553'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:20.995743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45692e8a0da14990b6ac83e70e3aed57', 'request_id': 'req-8aa8514a-c007-4e23-8a62-d07dd6701553'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.010403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] The token cache is being invalidate because project 45692e8a0da14990b6ac83e70e3aed57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:21.010800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.012914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.014259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 912/1801] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:20 2022] DELETE /identity/v3/projects/45692e8a0da14990b6ac83e70e3aed57 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:21.017972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.019926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.045266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.046620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.046927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.047317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] PATH_INFO: `/v3/projects/3d94f2fc77a14bf0b8035856c6a90065` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.048920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d94f2fc77a14bf0b8035856c6a90065)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.050909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.097047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8514a-c007-4e23-8a62-d07dd6701553 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.105771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d94f2fc77a14bf0b8035856c6a90065', 'request_id': 'req-5039daed-ed42-4995-be36-244d6a5b2d96'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.113145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d94f2fc77a14bf0b8035856c6a90065', 'request_id': 'req-5039daed-ed42-4995-be36-244d6a5b2d96'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.122795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d94f2fc77a14bf0b8035856c6a90065', 'request_id': 'req-5039daed-ed42-4995-be36-244d6a5b2d96'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.141276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] The token cache is being invalidate because project 3d94f2fc77a14bf0b8035856c6a90065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:21.141744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.142889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5039daed-ed42-4995-be36-244d6a5b2d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.145295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 890/1802] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:20 2022] DELETE /identity/v3/projects/3d94f2fc77a14bf0b8035856c6a90065 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:21.151230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080767c4-08b9-47ae-b9b7-cda96a017a8e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.152300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080767c4-08b9-47ae-b9b7-cda96a017a8e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.152814 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080767c4-08b9-47ae-b9b7-cda96a017a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.173838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-080767c4-08b9-47ae-b9b7-cda96a017a8e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:21.175464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-080767c4-08b9-47ae-b9b7-cda96a017a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.178983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.180214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.180490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.180880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] PATH_INFO: `/v3/users/479d34fe2bda4b7ea7e1e7292d4596cf` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.182090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479d34fe2bda4b7ea7e1e7292d4596cf)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.183999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.189836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 891/1803] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:21.193671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.194140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.194418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.215091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:21.216366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.224617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 892/1804] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:21.229634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.238622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5a28-fa69-470d-959a-40cf8e7df06b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.243425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479d34fe2bda4b7ea7e1e7292d4596cf'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.243969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479d34fe2bda4b7ea7e1e7292d4596cf'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.244215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.244872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.245152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.245424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.246216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:21.246524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.248121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.255554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479d34fe2bda4b7ea7e1e7292d4596cf'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.260008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 893/1805] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:21.263355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479d34fe2bda4b7ea7e1e7292d4596cf'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.264083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479d34fe2bda4b7ea7e1e7292d4596cf'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.264262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.265902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.276997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 913/1806] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:21 2022] DELETE /identity/v3/users/479d34fe2bda4b7ea7e1e7292d4596cf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:21.278881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c26c5-8ef7-4fbe-a3fe-a2eb8e71d3a6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.333314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.334078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.334288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.335068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.335252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.337832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.365513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 894/1807] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:21.370235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.379941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467da5-e0d8-4ffb-9332-1b9130833325 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.438646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.439329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.439610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.439886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.440605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.442561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.451629 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.454251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.466148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 914/1808] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:21.469913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.473932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ea29-4dc3-4ad4-8b99-567d2f89ea95 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.480602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac4b75-8f35-483f-95e4-fede49d8f148 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.482642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.483527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.483809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.484080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] PATH_INFO: `/v3/projects/1be68fce524c40108a40284a8a011dac` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.485242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be68fce524c40108a40284a8a011dac)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.486101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.486775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.487058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.487266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.487371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.488054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.489994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.500739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 915/1809] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:21.504554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.514570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96476c0-a6ce-4728-ad09-f58996cc49c7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.519714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.520451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.520724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.521004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.521728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.524549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.535311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 916/1810] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:21.539625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be68fce524c40108a40284a8a011dac', 'request_id': 'req-09efcebf-eeff-41ac-92c6-49d1040ec461'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.539746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.545953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be68fce524c40108a40284a8a011dac', 'request_id': 'req-09efcebf-eeff-41ac-92c6-49d1040ec461'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.549024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec017499-ba0d-4b65-867d-ddd5d84854a6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.551357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be68fce524c40108a40284a8a011dac', 'request_id': 'req-09efcebf-eeff-41ac-92c6-49d1040ec461'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.565185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] The token cache is being invalidate because project 1be68fce524c40108a40284a8a011dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:21.565488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.566172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-09efcebf-eeff-41ac-92c6-49d1040ec461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:21.567755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 895/1811] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:21 2022] DELETE /identity/v3/projects/1be68fce524c40108a40284a8a011dac => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:21.572967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9efba-49a1-471a-a73a-a443b4efab6c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.573388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9efba-49a1-471a-a73a-a443b4efab6c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.573693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9efba-49a1-471a-a73a-a443b4efab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.593737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-42e9efba-49a1-471a-a73a-a443b4efab6c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:21.594973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-42e9efba-49a1-471a-a73a-a443b4efab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.607835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76896cac-750f-4b57-8493-907d345e1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.608734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76896cac-750f-4b57-8493-907d345e1eff admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.609012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76896cac-750f-4b57-8493-907d345e1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.609284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76896cac-750f-4b57-8493-907d345e1eff admin admin] PATH_INFO: `/v3/projects/8f138263a3fb4d4aabb83cc704f8bffd/users/e965de41aa82445e978ef9b1a10e3eb2/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.624748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76896cac-750f-4b57-8493-907d345e1eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f138263a3fb4d4aabb83cc704f8bffd, user_id=e965de41aa82445e978ef9b1a10e3eb2, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.627391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76896cac-750f-4b57-8493-907d345e1eff admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.645889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 917/1812] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:21 2022] PUT /identity/v3/projects/8f138263a3fb4d4aabb83cc704f8bffd/users/e965de41aa82445e978ef9b1a10e3eb2/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:21.655886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.656270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.656621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.669831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 896/1813] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:21.672415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.672703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.672980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.693818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] MFA Rules not processed for user `e965de41aa82445e978ef9b1a10e3eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:21.695903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.702618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:21.703875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.765848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 918/1814] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:21.771482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.772856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:21.796047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 897/1815] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:21.800252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.809525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0c9b8-f21b-4025-b5dd-dbc1a3e7e14d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.814281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.814925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.815206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.815486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.816210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:21.816512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.818174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.833259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 898/1816] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:21.834184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.840526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41740-9579-42ad-bdc7-b5d467aabe58 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.843684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d3c90-c793-4f70-9933-3ebb483d2bc2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.846140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.846925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.847299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.847703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.848249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.848628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.848886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.849168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.849451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.850223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.851345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.852408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.886819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 919/1817] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:21.886992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 899/1818] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:21.887102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.890832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.948884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba480d-4392-4c6b-baa1-854b09c29c3f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.954590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.955236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a95bf-03a2-4a6c-9cf9-da84a601d4c3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:21.955352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.955601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.955898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.956636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.959172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.959913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:21.960687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:21.961766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:21.962151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:21.962919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:21.964896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:21.983996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 920/1819] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:21.987730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 900/1820] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:21 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:21.987879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.993379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:21.999521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd5e3-266a-4002-847b-c24c16ef1b37 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.003910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e6dea-fe35-4197-8798-39fe30288742 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.004934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.005590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.005903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.006239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.006928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.008540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.011708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.012576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.012975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.013408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.014741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.016401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.018720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 921/1821] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:22.022850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.031697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 901/1822] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:22.032825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2fe2-c15a-4c0d-a215-76108c4d0225 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.036008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.038479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.040184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.040604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.040887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] PATH_INFO: `/v3/projects/7009720791ae4b679bdd113bf124fec5/users/6d9efe25500846b2a6215800edb995b4/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.047245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ded105-cf00-48a9-8719-e46b038d65a9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.053491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.054194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.055061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.055603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.056338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.056665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7009720791ae4b679bdd113bf124fec5, user_id=6d9efe25500846b2a6215800edb995b4, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.058071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.059569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.069574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 902/1823] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:22.074011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.074976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 922/1824] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:22 2022] PUT /identity/v3/projects/7009720791ae4b679bdd113bf124fec5/users/6d9efe25500846b2a6215800edb995b4/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:22.078598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.086698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a696741-b339-4397-a1b7-886ed50c33fa admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.143195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43fce9-ff57-4618-8820-71789efa90f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.143992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43fce9-ff57-4618-8820-71789efa90f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.144268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43fce9-ff57-4618-8820-71789efa90f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.144537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43fce9-ff57-4618-8820-71789efa90f8 admin admin] PATH_INFO: `/v3/projects/d3bdcf2228c14182b25ba8b7ae5bed2a/users/e304590c7cb54e42a7ad31e89da7b64b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.151454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e364323-1dcb-4406-9ba2-849b9e45b6af admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.156818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.157719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.158048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.158797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.159530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.160351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43fce9-ff57-4618-8820-71789efa90f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bdcf2228c14182b25ba8b7ae5bed2a, user_id=e304590c7cb54e42a7ad31e89da7b64b, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.161129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.165002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43fce9-ff57-4618-8820-71789efa90f8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.173529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 923/1825] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:22.177743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.190062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcd6ae-008e-416d-bb4d-a0b9488755cd admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.197352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6a297-fda4-4e75-b90e-ffe80bdbc626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.198616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6a297-fda4-4e75-b90e-ffe80bdbc626 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.199037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6a297-fda4-4e75-b90e-ffe80bdbc626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.199520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6a297-fda4-4e75-b90e-ffe80bdbc626 admin admin] PATH_INFO: `/v3/projects/7009720791ae4b679bdd113bf124fec5/users/6d9efe25500846b2a6215800edb995b4/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.201859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6a297-fda4-4e75-b90e-ffe80bdbc626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7009720791ae4b679bdd113bf124fec5, user_id=6d9efe25500846b2a6215800edb995b4, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.204829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6a297-fda4-4e75-b90e-ffe80bdbc626 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.205891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 903/1826] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:22 2022] PUT /identity/v3/projects/d3bdcf2228c14182b25ba8b7ae5bed2a/users/e304590c7cb54e42a7ad31e89da7b64b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:22.216497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.216794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.217075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.228939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 924/1827] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:22 2022] PUT /identity/v3/projects/7009720791ae4b679bdd113bf124fec5/users/6d9efe25500846b2a6215800edb995b4/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:22.230976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.231666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.232032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.269150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] MFA Rules not processed for user `e304590c7cb54e42a7ad31e89da7b64b`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:22.270630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:22.271228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] MFA Rules not processed for user `6d9efe25500846b2a6215800edb995b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:22.272559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:22.361109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 904/1828] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:22.366117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 925/1829] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:22.368076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.379289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.381418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:22.443251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76968850-77e6-4714-849c-e0c7eb5b68da None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.446290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339fae-dfdd-48d1-a879-638ee42f32b4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.447387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.448037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.448315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.448588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.451370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.452293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.452676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.453042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.453871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.455872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.458868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.460292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.472453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 926/1830] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:22.490983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 905/1831] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:22.495995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.508875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d75435-4369-4414-a8de-8eb6cb66c369 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.585539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.586435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.586712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.586989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.587707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.590127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.618477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 927/1832] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:22.622151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.633402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3fcea-b47f-486d-85cb-d40acb4dc06a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.638162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.638839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.639120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.639393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.640131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.641733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.652511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 906/1833] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:22.656759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.667419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42346-f9b3-47e2-898f-5ff2f251e1cc admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.672629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970840a-9656-4373-a403-6f759f3b3062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.673303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970840a-9656-4373-a403-6f759f3b3062 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.673682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970840a-9656-4373-a403-6f759f3b3062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.674033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970840a-9656-4373-a403-6f759f3b3062 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.674807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970840a-9656-4373-a403-6f759f3b3062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.676520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970840a-9656-4373-a403-6f759f3b3062 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.689550 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 928/1834] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:22.692627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.703906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ce35f-8553-4c4b-a2eb-d35e8732aece admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.709236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.710156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.710440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.710966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] PATH_INFO: `/v3/projects/96c107b305ba4eeaab74dafb58541dba/users/880e87a1723b4ec5b278f69c03620024/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.728366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c107b305ba4eeaab74dafb58541dba, user_id=880e87a1723b4ec5b278f69c03620024, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.731033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.745511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 907/1835] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:22 2022] PUT /identity/v3/projects/96c107b305ba4eeaab74dafb58541dba/users/880e87a1723b4ec5b278f69c03620024/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:22.755960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81311129-fead-48b0-8942-7636921b0f4d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.756686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81311129-fead-48b0-8942-7636921b0f4d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.756686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81311129-fead-48b0-8942-7636921b0f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.786477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-81311129-fead-48b0-8942-7636921b0f4d None None] MFA Rules not processed for user `880e87a1723b4ec5b278f69c03620024`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:22.787678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-81311129-fead-48b0-8942-7636921b0f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:22.854514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.875151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 929/1836] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:22.879095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81311129-fead-48b0-8942-7636921b0f4d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.924862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4490cb-606d-496d-b2fe-7f514fbbe601 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.930188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9efe25500846b2a6215800edb995b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7009720791ae4b679bdd113bf124fec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.930856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.931163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.932107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.932851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:22.933163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.934793 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.946781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 908/1837] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:22.947394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81311129-fead-48b0-8942-7636921b0f4d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.950925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:22.952330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.953011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.953299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.953574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.954360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.956189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.961784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75138e2a-2412-414d-b413-8863e9b7da0a tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:22.967034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9efe25500846b2a6215800edb995b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7009720791ae4b679bdd113bf124fec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:22.967691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:22.967979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:22.968261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:22.968955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:22.970884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:22.988378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 930/1838] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:22.993261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.002462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 909/1839] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:23.003680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.057920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb431467-27ab-4bb1-9d5d-c7cc8edaa371 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.067773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32463fe-e08f-4051-8ecd-e1a3d884852f tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.072851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9efe25500846b2a6215800edb995b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7009720791ae4b679bdd113bf124fec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.073774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.074097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.074372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.075497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:23.075497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.077108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.090799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 910/1840] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:23.122761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.123442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.123726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.124003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.124701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.126708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.136014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.146061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d648-722c-4b23-8647-69587a8305a3 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.151362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 931/1841] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:22 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:23.152103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9efe25500846b2a6215800edb995b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7009720791ae4b679bdd113bf124fec5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.152419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.153210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.153555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.153966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] PATH_INFO: `/v3/projects/bbdce9b9ecba42a2a3b0d62e9f43b85c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.155265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbdce9b9ecba42a2a3b0d62e9f43b85c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.157291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.162226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00d74d-e9ca-43fe-a8f2-5a93c530e6e5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.167020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.167664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.168053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.168224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.168957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.170592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.181397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 932/1842] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:23.185435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.197517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb33a-d717-4ac3-b7f6-3571ce60d8d8 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.204678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.205503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.205783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.206093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] PATH_INFO: `/v3/projects/4ca8fbb6b6f84ff0848e3691813b8b8e/users/4f0c6ffb37de4636b5fe960289e22ab7/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.221645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca8fbb6b6f84ff0848e3691813b8b8e, user_id=4f0c6ffb37de4636b5fe960289e22ab7, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.224291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.224556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdce9b9ecba42a2a3b0d62e9f43b85c', 'request_id': 'req-6c424d75-0ae5-4b6a-b099-04bdd465d194'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.232201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdce9b9ecba42a2a3b0d62e9f43b85c', 'request_id': 'req-6c424d75-0ae5-4b6a-b099-04bdd465d194'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.237422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 933/1843] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:23 2022] PUT /identity/v3/projects/4ca8fbb6b6f84ff0848e3691813b8b8e/users/4f0c6ffb37de4636b5fe960289e22ab7/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:23.237716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdce9b9ecba42a2a3b0d62e9f43b85c', 'request_id': 'req-6c424d75-0ae5-4b6a-b099-04bdd465d194'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.241028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.251717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] The token cache is being invalidate because project bbdce9b9ecba42a2a3b0d62e9f43b85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:23.252009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.252654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.254251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 911/1844] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:23 2022] DELETE /identity/v3/projects/bbdce9b9ecba42a2a3b0d62e9f43b85c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:23.314802 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6d5c-2bdf-467d-9c6b-d9faaad6968f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.319486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7b56-d0e7-4d14-922d-caa8c40018be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.320722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7b56-d0e7-4d14-922d-caa8c40018be admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.321003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7b56-d0e7-4d14-922d-caa8c40018be admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.321276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7b56-d0e7-4d14-922d-caa8c40018be admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.322137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7b56-d0e7-4d14-922d-caa8c40018be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.323720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7b56-d0e7-4d14-922d-caa8c40018be admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.334843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 934/1845] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:23.339469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.340910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.409931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424d75-0ae5-4b6a-b099-04bdd465d194 tempest-VolumeQuotaClassesTest-1751257643 tempest-VolumeQuotaClassesTest-1751257643-project-admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.415170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.416155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.416497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.416833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] PATH_INFO: `/v3/projects/4ca8fbb6b6f84ff0848e3691813b8b8e/users/4f0c6ffb37de4636b5fe960289e22ab7/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.419253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca8fbb6b6f84ff0848e3691813b8b8e, user_id=4f0c6ffb37de4636b5fe960289e22ab7, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.422064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.442685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 912/1846] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:23 2022] PUT /identity/v3/projects/4ca8fbb6b6f84ff0848e3691813b8b8e/users/4f0c6ffb37de4636b5fe960289e22ab7/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:23.447042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.447415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.447764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.481163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] MFA Rules not processed for user `4f0c6ffb37de4636b5fe960289e22ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:23.482729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.491093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.493750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.553641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 935/1847] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:23.557774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35266f-f90b-4024-a29b-4e1679d0e789 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.562941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.563823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.564105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.564380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] PATH_INFO: `/v3/users/e965de41aa82445e978ef9b1a10e3eb2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.565563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.565842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e965de41aa82445e978ef9b1a10e3eb2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.566918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.567762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.614030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e965de41aa82445e978ef9b1a10e3eb2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.614708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e965de41aa82445e978ef9b1a10e3eb2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.628065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273538e-9779-448f-a281-618332b5c8a3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.630920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e965de41aa82445e978ef9b1a10e3eb2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.632091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.632846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.633133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.633410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.639530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e965de41aa82445e978ef9b1a10e3eb2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.640367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e9e556bf-3108-4c67-b6e1-1437b50036e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e965de41aa82445e978ef9b1a10e3eb2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:23.643944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.645757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.655028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 913/1848] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:23 2022] DELETE /identity/v3/users/e965de41aa82445e978ef9b1a10e3eb2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:23.656753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 936/1849] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:23.659214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.659500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.659777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.677705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:23.680719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.701377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.702935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.714366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5eddc-d8e2-4bb3-a891-8c63af613456 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.739237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 914/1850] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:23.750023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:23.751388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.763716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.764691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.764984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.765262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.767089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:23.806154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40249-807a-40ac-82da-c2846f4ddb43 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:23.809881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:23.810528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:23.810812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:23.811088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:23.821601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.823256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.826104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:23.827616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:23.833168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 915/1851] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:23.837788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 937/1852] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:24.163277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:24.165926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:24.181518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeafbf1-de51-4263-87dd-1490fde30fcd service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:24.189134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:24.190343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:24.190735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:24.191126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] PATH_INFO: `/v3/projects/8f138263a3fb4d4aabb83cc704f8bffd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:24.198757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f138263a3fb4d4aabb83cc704f8bffd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:24.206645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:24.262072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f138263a3fb4d4aabb83cc704f8bffd', 'request_id': 'req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.268616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f138263a3fb4d4aabb83cc704f8bffd', 'request_id': 'req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.274845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f138263a3fb4d4aabb83cc704f8bffd', 'request_id': 'req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.287241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] The token cache is being invalidate because project 8f138263a3fb4d4aabb83cc704f8bffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:24.287526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.288156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.290194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 916/1853] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:24 2022] DELETE /identity/v3/projects/8f138263a3fb4d4aabb83cc704f8bffd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:24.294330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:24.305607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d8fb0-df57-44f2-83d4-9b1937cdd2e7 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:24.366685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:24.367591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:24.367993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:24.368274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] PATH_INFO: `/v3/users/6d9efe25500846b2a6215800edb995b4` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:24.369494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9efe25500846b2a6215800edb995b4)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:24.371617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:24.416439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9efe25500846b2a6215800edb995b4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.417112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9efe25500846b2a6215800edb995b4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.428146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9efe25500846b2a6215800edb995b4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.434697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9efe25500846b2a6215800edb995b4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.435321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-46f728cd-8133-4704-88bd-aac245f93b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9efe25500846b2a6215800edb995b4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.448211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 938/1854] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:24 2022] DELETE /identity/v3/users/6d9efe25500846b2a6215800edb995b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:24.717137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:24.718679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:24.733987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda1c4-b737-47ac-b7b4-6e46dd1f8588 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:24.790113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:24.790880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:24.791159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:24.791430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] PATH_INFO: `/v3/projects/7009720791ae4b679bdd113bf124fec5` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:24.792603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7009720791ae4b679bdd113bf124fec5)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:24.794519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:24.840433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7009720791ae4b679bdd113bf124fec5', 'request_id': 'req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.846714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7009720791ae4b679bdd113bf124fec5', 'request_id': 'req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.852534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7009720791ae4b679bdd113bf124fec5', 'request_id': 'req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.864857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] The token cache is being invalidate because project 7009720791ae4b679bdd113bf124fec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:24.865179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.865859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0c6b3ac5-1357-4a84-8f4b-227a2c8cf0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:24.868430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 917/1855] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:24 2022] DELETE /identity/v3/projects/7009720791ae4b679bdd113bf124fec5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:24.874927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:24.875222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:24.875530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:24.894985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:24.896177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:24.954724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 939/1856] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:24.962639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:24.962934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:24.963211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:24.981573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:24.982845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:24.990582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 918/1857] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:24.995615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.004972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36331bd-5d19-4237-b71e-44e50407a2db None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.009533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.010220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.010497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.010772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.011520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:25.011841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.013416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.025319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 940/1858] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:25.029899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.039628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8052c-e3bc-41b9-bd99-d0f722615d25 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.044923 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.045390 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.045671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.045984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.046670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.048556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.073678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 919/1859] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:25 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:25.078008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.088148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91046-b92b-4a3f-a429-ce4942dc9e5a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.145149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.146236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.146521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.146801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.147493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.149416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.170783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 941/1860] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:25 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:25.175035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.186320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2e5a8-087c-4387-b6c1-f7439496014b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.191103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.191873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.192256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.192630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.193462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.195238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.209817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 920/1861] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:25.210869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.221499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f4fe8-740b-43a6-bbd3-53e8243cddaa admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.227442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e924e-0e7a-47a5-89d4-52ab5ba5fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.227997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e924e-0e7a-47a5-89d4-52ab5ba5fc12 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.228407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e924e-0e7a-47a5-89d4-52ab5ba5fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.228687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e924e-0e7a-47a5-89d4-52ab5ba5fc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.229418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e924e-0e7a-47a5-89d4-52ab5ba5fc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.231061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e924e-0e7a-47a5-89d4-52ab5ba5fc12 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.256533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 942/1862] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:25.256739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.267922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56048-13fd-4d52-ac53-4b6fa64bd95d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.275435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.276778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.277061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.277623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] PATH_INFO: `/v3/projects/643c6e09b59c40e0901a28036bd39c14/users/fd45e5781fdb4507b4d16c467edda71a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.296365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=643c6e09b59c40e0901a28036bd39c14, user_id=fd45e5781fdb4507b4d16c467edda71a, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.297929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.323753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 921/1863] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:25 2022] PUT /identity/v3/projects/643c6e09b59c40e0901a28036bd39c14/users/fd45e5781fdb4507b4d16c467edda71a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:25.325913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.326343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.326944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.354013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] MFA Rules not processed for user `fd45e5781fdb4507b4d16c467edda71a`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:25.355322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:25.424455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 943/1864] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:25.435513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:25.437268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:25.496861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7e97e-22ad-43c7-9024-4fade2f6ed1d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:25.500809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25acb0d-f37f-49a1-ac39-c4c85b04d437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:25.501594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25acb0d-f37f-49a1-ac39-c4c85b04d437 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:25.501911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25acb0d-f37f-49a1-ac39-c4c85b04d437 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:25.502214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25acb0d-f37f-49a1-ac39-c4c85b04d437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:25.511545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25acb0d-f37f-49a1-ac39-c4c85b04d437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:25.513286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25acb0d-f37f-49a1-ac39-c4c85b04d437 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:25.522655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 922/1865] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:26.458919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:26.468519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d17a8-a7f8-417a-ad06-c39e35be46c0 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:26.472325 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:26.472980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:26.473261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:26.473535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:26.475348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:26.540742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:26.542223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92248-0e84-4692-9e7f-57ef44ba521c service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:26.551547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 944/1866] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:29.318693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cbec8-8f55-4928-bc8f-16f872c33688 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:29.319217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cbec8-8f55-4928-bc8f-16f872c33688 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:29.319549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cbec8-8f55-4928-bc8f-16f872c33688 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:29.321970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 923/1867] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:27:29.340575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf25529-0729-4ded-9260-35852e141455 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:29.342140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf25529-0729-4ded-9260-35852e141455 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:29.343434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf25529-0729-4ded-9260-35852e141455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:29.375977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-bdf25529-0729-4ded-9260-35852e141455 None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:29.378049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bdf25529-0729-4ded-9260-35852e141455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:29.506882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 945/1868] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:27:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:29.525248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cbec8-8f55-4928-bc8f-16f872c33688 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:29.527348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1b3cbec8-8f55-4928-bc8f-16f872c33688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:29.554608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cbec8-8f55-4928-bc8f-16f872c33688 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:29.562048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d1795-6802-41f8-87c7-273409649eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:29.562819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d1795-6802-41f8-87c7-273409649eea service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:29.563276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d1795-6802-41f8-87c7-273409649eea service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:29.563677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d1795-6802-41f8-87c7-273409649eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:29.575557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d1795-6802-41f8-87c7-273409649eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:29.576239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d1795-6802-41f8-87c7-273409649eea service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:29.589415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 924/1869] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:31.045854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf25529-0729-4ded-9260-35852e141455 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:31.047358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bdf25529-0729-4ded-9260-35852e141455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:31.110560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf25529-0729-4ded-9260-35852e141455 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:31.115345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:31.116528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:31.116832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:31.117108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] PATH_INFO: `/v3/users/e304590c7cb54e42a7ad31e89da7b64b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:31.118631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e304590c7cb54e42a7ad31e89da7b64b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:31.120541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:31.165833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e304590c7cb54e42a7ad31e89da7b64b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.166592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e304590c7cb54e42a7ad31e89da7b64b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.178102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e304590c7cb54e42a7ad31e89da7b64b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.184683 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e304590c7cb54e42a7ad31e89da7b64b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.185402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e304590c7cb54e42a7ad31e89da7b64b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.199182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 946/1870] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:31 2022] DELETE /identity/v3/users/e304590c7cb54e42a7ad31e89da7b64b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:31.203680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:31.204838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:31.205160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:31.223024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:31.224198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:31.293993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 925/1871] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:31.303883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:31.305432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:31.376957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec9a2-2704-498e-949e-92dda3c8cb35 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:31.383089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:31.384341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:31.384879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:31.385362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:31.400975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:31.403507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:31.417013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 947/1872] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:31.764553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:31.766636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:31.793984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3893d5-d610-43dd-a59a-91a4f1587b0b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:31.799697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:31.800745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:31.801546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:31.801857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] PATH_INFO: `/v3/projects/d3bdcf2228c14182b25ba8b7ae5bed2a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:31.803515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bdcf2228c14182b25ba8b7ae5bed2a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:31.806363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:31.863797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bdcf2228c14182b25ba8b7ae5bed2a', 'request_id': 'req-2668f82f-b1c8-4644-86d1-62763e241409'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.870168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bdcf2228c14182b25ba8b7ae5bed2a', 'request_id': 'req-2668f82f-b1c8-4644-86d1-62763e241409'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.875736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bdcf2228c14182b25ba8b7ae5bed2a', 'request_id': 'req-2668f82f-b1c8-4644-86d1-62763e241409'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.888630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] The token cache is being invalidate because project d3bdcf2228c14182b25ba8b7ae5bed2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:31.888996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.889627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:31.892841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 926/1873] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:31 2022] DELETE /identity/v3/projects/d3bdcf2228c14182b25ba8b7ae5bed2a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:31.896639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:31.907221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81bea5-abf4-4084-b2ec-18dadb184efd service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:31.970730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:31.971527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:31.971801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:31.972073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] PATH_INFO: `/v3/users/880e87a1723b4ec5b278f69c03620024` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:31.973962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880e87a1723b4ec5b278f69c03620024)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:31.975217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:32.024301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880e87a1723b4ec5b278f69c03620024'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.026497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880e87a1723b4ec5b278f69c03620024'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.041525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880e87a1723b4ec5b278f69c03620024'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.049555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880e87a1723b4ec5b278f69c03620024'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.050876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880e87a1723b4ec5b278f69c03620024'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.068331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 948/1874] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:31 2022] DELETE /identity/v3/users/880e87a1723b4ec5b278f69c03620024 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:32.183825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:32.185356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:32.199555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668f82f-b1c8-4644-86d1-62763e241409 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:32.287633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:32.288797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:32.289164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:32.289697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] PATH_INFO: `/v3/users/b1074771f31844869bb8e7264e761ca8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:32.291488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1074771f31844869bb8e7264e761ca8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:32.295640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:32.388152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1074771f31844869bb8e7264e761ca8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.389086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1074771f31844869bb8e7264e761ca8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.403923 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1074771f31844869bb8e7264e761ca8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.410280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:32.412242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:32.414143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1074771f31844869bb8e7264e761ca8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.414981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-138577fd-4a16-478b-bdae-dbe44dcb2576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1074771f31844869bb8e7264e761ca8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.440209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c68cb-b054-43e3-8b55-ff1d85191725 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:32.440477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 927/1875] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:32 2022] DELETE /identity/v3/users/b1074771f31844869bb8e7264e761ca8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:32.447252 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:32.447752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:32.448179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:32.488532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:32.489750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:32.520685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:32.522071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:32.522359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:32.522641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] PATH_INFO: `/v3/projects/96c107b305ba4eeaab74dafb58541dba` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:32.524012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c107b305ba4eeaab74dafb58541dba)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:32.526832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:32.558516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 928/1876] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:32.568083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:32.569568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:32.576309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c107b305ba4eeaab74dafb58541dba', 'request_id': 'req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.582204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c107b305ba4eeaab74dafb58541dba', 'request_id': 'req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.587744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c107b305ba4eeaab74dafb58541dba', 'request_id': 'req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.600720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] The token cache is being invalidate because project 96c107b305ba4eeaab74dafb58541dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:32.601546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.602323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.604115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 949/1877] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:32 2022] DELETE /identity/v3/projects/96c107b305ba4eeaab74dafb58541dba => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:32.607872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:32.609190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:32.624905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda9c13-9d70-4fdf-ae30-4fa231f58b4d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:32.677533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:32.678238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:32.678528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:32.678795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:32.681417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:32.684856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45e96c-e1e8-4b3a-b2f4-c4bab6ee6bb1 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:32.690298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:32.691405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:32.691692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:32.691973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] PATH_INFO: `/v3/users/4f0c6ffb37de4636b5fe960289e22ab7` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:32.693207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0c6ffb37de4636b5fe960289e22ab7)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:32.694162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:32.695700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:32.695977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:32.705614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 929/1878] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:32.746323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0c6ffb37de4636b5fe960289e22ab7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.747035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0c6ffb37de4636b5fe960289e22ab7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.759548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0c6ffb37de4636b5fe960289e22ab7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.766403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0c6ffb37de4636b5fe960289e22ab7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.767178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0c6ffb37de4636b5fe960289e22ab7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:32.786563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 950/1879] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:32 2022] DELETE /identity/v3/users/4f0c6ffb37de4636b5fe960289e22ab7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:33.174479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:33.176627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:33.202380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b0d7e-acd7-402a-82d0-8fabc28796e9 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:33.317404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:33.318436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:33.318813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:33.319247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] PATH_INFO: `/v3/projects/b8a4cb84f9e447b4bbe2f2fa4ae1cd35` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:33.323384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a4cb84f9e447b4bbe2f2fa4ae1cd35)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:33.325816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:33.405651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a4cb84f9e447b4bbe2f2fa4ae1cd35', 'request_id': 'req-fe867eaa-7608-4e1b-8331-bcd9c6838546'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.419392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a4cb84f9e447b4bbe2f2fa4ae1cd35', 'request_id': 'req-fe867eaa-7608-4e1b-8331-bcd9c6838546'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.426284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:33.427856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:33.434184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a4cb84f9e447b4bbe2f2fa4ae1cd35', 'request_id': 'req-fe867eaa-7608-4e1b-8331-bcd9c6838546'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.455380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1929e-34f6-4688-920b-28abd9388aeb admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:33.457918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] The token cache is being invalidate because project b8a4cb84f9e447b4bbe2f2fa4ae1cd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:33.458527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.461205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.463038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 930/1880] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:33 2022] DELETE /identity/v3/projects/b8a4cb84f9e447b4bbe2f2fa4ae1cd35 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:33.467209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:33.469280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:33.553054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867eaa-7608-4e1b-8331-bcd9c6838546 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:33.559115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:33.560597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:33.561040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:33.562131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] PATH_INFO: `/v3/users/417886f47d924ef1a906ff25d7114022` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:33.563918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=417886f47d924ef1a906ff25d7114022)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:33.568537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:33.595862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:33.596855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:33.597160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:33.597462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] PATH_INFO: `/v3/projects/4ca8fbb6b6f84ff0848e3691813b8b8e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:33.601567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca8fbb6b6f84ff0848e3691813b8b8e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:33.603709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:33.641197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417886f47d924ef1a906ff25d7114022'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.642641 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417886f47d924ef1a906ff25d7114022'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.661205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417886f47d924ef1a906ff25d7114022'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.674075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417886f47d924ef1a906ff25d7114022'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.675952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ba7b3dfe-5274-4335-9a35-2d0c0da9c375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417886f47d924ef1a906ff25d7114022'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.706452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 931/1881] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:33 2022] DELETE /identity/v3/users/417886f47d924ef1a906ff25d7114022 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:33.708817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca8fbb6b6f84ff0848e3691813b8b8e', 'request_id': 'req-9a3ad639-9ee7-4124-b714-54a8b667ba7b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.716644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca8fbb6b6f84ff0848e3691813b8b8e', 'request_id': 'req-9a3ad639-9ee7-4124-b714-54a8b667ba7b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.722758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca8fbb6b6f84ff0848e3691813b8b8e', 'request_id': 'req-9a3ad639-9ee7-4124-b714-54a8b667ba7b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.748704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] The token cache is being invalidate because project 4ca8fbb6b6f84ff0848e3691813b8b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:33.749365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.751546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9a3ad639-9ee7-4124-b714-54a8b667ba7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:33.757554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 951/1882] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:33 2022] DELETE /identity/v3/projects/4ca8fbb6b6f84ff0848e3691813b8b8e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:33.763802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:33.764493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:33.765016 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:33.800839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:33.802547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:33.979133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 932/1883] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:33.987142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:33.987642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:33.988106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.011844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:34.013899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.025101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 952/1884] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:34.029348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.043152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d538-2771-4e25-8cf4-578a4c99cc46 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.061862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.062779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.063101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.063485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.064769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:34.065159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.066897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.081486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 933/1885] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:34.086930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.098270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49024a8-c240-40e8-88d7-47eb9640caaf None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.104350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.105571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.106464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.107027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.108220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.110847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.161776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 953/1886] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:34.172133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.182521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106d23c-4f81-4a5e-a78e-dfe32a8faa35 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.252084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.254123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.260253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.261997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.262409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.262744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.263457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.265671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.270283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2fce-ce31-4ddd-a5d9-6d1fbd76851b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.278436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.279703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.279832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.280245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] PATH_INFO: `/v3/projects/64c5cbafa1db49e4ac9d45d03f5fe624` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.281788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c5cbafa1db49e4ac9d45d03f5fe624)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.284071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.301850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 934/1887] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:34.304133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.313988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a6f-690b-4218-95f6-54fceea663a7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.320886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.322340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.322340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.322530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.323413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.325289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.337536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 935/1888] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:34.340846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.351769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b39f1-eefa-4465-bd42-508381c41ab2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.353474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c5cbafa1db49e4ac9d45d03f5fe624', 'request_id': 'req-937d3682-3375-45e3-90d7-52ba10bee160'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:34.361540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c5cbafa1db49e4ac9d45d03f5fe624', 'request_id': 'req-937d3682-3375-45e3-90d7-52ba10bee160'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:34.368571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c5cbafa1db49e4ac9d45d03f5fe624', 'request_id': 'req-937d3682-3375-45e3-90d7-52ba10bee160'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:34.384019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] The token cache is being invalidate because project 64c5cbafa1db49e4ac9d45d03f5fe624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:34.384019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:34.384178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-937d3682-3375-45e3-90d7-52ba10bee160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:34.386495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 954/1889] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:34 2022] DELETE /identity/v3/projects/64c5cbafa1db49e4ac9d45d03f5fe624 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:34.392791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3591f-5176-4d54-94d8-9f297742aebd None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.393261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3591f-5176-4d54-94d8-9f297742aebd None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.393544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3591f-5176-4d54-94d8-9f297742aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.423416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0fe3591f-5176-4d54-94d8-9f297742aebd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:34.424720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0fe3591f-5176-4d54-94d8-9f297742aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.435649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.436420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.436751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.437540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.438544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.440131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.455118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 936/1890] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:34.464751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.466673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.502197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0d77e-ff0f-4211-b9f6-bbf9795e5785 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.514762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 955/1891] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:34.515366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee21ccc-3691-4fa6-a8b4-bc9c183053cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.517483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21ccc-3691-4fa6-a8b4-bc9c183053cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.519017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21ccc-3691-4fa6-a8b4-bc9c183053cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.519385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21ccc-3691-4fa6-a8b4-bc9c183053cc admin admin] PATH_INFO: `/v3/projects/88d569962559476a825077568cc51303/users/1ee456af199e4ded952ef36508abc759/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.523608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.524267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.524761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.549195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee21ccc-3691-4fa6-a8b4-bc9c183053cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d569962559476a825077568cc51303, user_id=1ee456af199e4ded952ef36508abc759, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.554380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee21ccc-3691-4fa6-a8b4-bc9c183053cc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.558859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:34.563034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.574427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 956/1892] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:34.577833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 937/1893] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:34 2022] PUT /identity/v3/projects/88d569962559476a825077568cc51303/users/1ee456af199e4ded952ef36508abc759/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:34.587520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.588677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.589022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.589307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.596710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f17e66-07ea-493d-91b1-b2ac43b7d00f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.620303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] MFA Rules not processed for user `1ee456af199e4ded952ef36508abc759`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:34.621509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.660062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.660821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.661211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.661422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.662358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:34.662678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.664516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.679882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 957/1894] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:34.684541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.695244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d393f-fe4c-4789-940b-870dc8d14c70 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.697057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 938/1895] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:34.700726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.701473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.701767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.702073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.702788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.704641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.708359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.709664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:34.731706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 958/1896] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:34.735740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.765960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ca591-6126-4f3a-a107-3827f15c204e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.797831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005730a-42ef-4b94-a31e-1350a1bcba91 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.804674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.805532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.805844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.806128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.806815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.808879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.817010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.817662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.818199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.818341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.833151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 959/1897] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:34.837561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.847538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeb7fe-2cc6-4c22-8d3f-c88d802f87f3 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.853386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.854202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.854495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.854776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.855510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.857242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.870082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 960/1898] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:34.873661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.886358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3347-88d1-4779-89e8-acd6b7793d45 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.891834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.892509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.893405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.893817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.894283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.894849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.895841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.897845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.903555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 939/1899] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:34.914815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 961/1900] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:34.916020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.927876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:34.931107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fbed0-f8f3-4403-8a5d-432db608f038 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.937708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599227e-9f94-47fd-b4a7-afe52777a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.938672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599227e-9f94-47fd-b4a7-afe52777a677 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.938955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599227e-9f94-47fd-b4a7-afe52777a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.939242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599227e-9f94-47fd-b4a7-afe52777a677 admin admin] PATH_INFO: `/v3/projects/30f53092c11b4066b2a483f8aa8be1a0/users/86154c7559c14eb5ba4c75916df71f42/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.940899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836fa7a-69ba-4bd8-a7af-8df9748df6cc admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:34.946384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:34.947268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.947555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.947832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] PATH_INFO: `/v3/users/1ee456af199e4ded952ef36508abc759` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:34.949328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee456af199e4ded952ef36508abc759)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.951486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.959344 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599227e-9f94-47fd-b4a7-afe52777a677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f53092c11b4066b2a483f8aa8be1a0, user_id=86154c7559c14eb5ba4c75916df71f42, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:34.964342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599227e-9f94-47fd-b4a7-afe52777a677 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:34.984320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 940/1901] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:34 2022] PUT /identity/v3/projects/30f53092c11b4066b2a483f8aa8be1a0/users/86154c7559c14eb5ba4c75916df71f42/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:34.997005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:34.997236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:34.997511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.010787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee456af199e4ded952ef36508abc759'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:35.011479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee456af199e4ded952ef36508abc759'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:35.026322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee456af199e4ded952ef36508abc759'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:35.036353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee456af199e4ded952ef36508abc759'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:35.037263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-6a0d8b8e-e662-43b1-a145-147bdcd9208f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee456af199e4ded952ef36508abc759'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:35.047951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] MFA Rules not processed for user `86154c7559c14eb5ba4c75916df71f42`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:35.049104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:35.052837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 962/1902] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:34 2022] DELETE /identity/v3/users/1ee456af199e4ded952ef36508abc759 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:35.057524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.057863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.058135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.077769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:35.079036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:35.148468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 941/1903] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:35.153450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.155759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:35.156954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 963/1904] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:35.167477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.171586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:35.253227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb4b34-3a4a-4999-92a2-cced82bfbdb8 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.262308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.263533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.263953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.264374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.286860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.289524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.293127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd713-3e15-4eaa-a1d1-ac198cf5f702 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.301650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.302431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.302736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.303026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.303733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.308874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.309055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 964/1905] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:35.344267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 942/1906] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:35 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:35.348252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.359797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564fd03-f6e9-428d-96e2-aee9e025025b service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.445571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.446323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.446610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.446888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.447610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.450277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.485419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 965/1907] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:35 2022] POST /identity/v3/users => generated 307 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:35.489155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.509502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a8951-fe02-44c0-8e14-e5450c2bc609 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.515357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.516036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.516327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.516609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.517351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.519183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.537068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 943/1908] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:35.538935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.558721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f995f-25b2-4c26-a15b-601634d98d5f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.563893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.564835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.565110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.565647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] PATH_INFO: `/v3/projects/f675be38661f4914a0ce2afae1bf076a/users/1ea3e2af59a74814ac2b1fe778338451/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.584857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f675be38661f4914a0ce2afae1bf076a, user_id=1ea3e2af59a74814ac2b1fe778338451, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.589733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.613159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 966/1909] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:35 2022] PUT /identity/v3/projects/f675be38661f4914a0ce2afae1bf076a/users/1ea3e2af59a74814ac2b1fe778338451/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:35.621824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.637681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088eeeb-8e76-4079-ba0a-ef749c39c8ce admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.672672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.675276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:35.757384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.758205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.758491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.758768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.759503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.761100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.787264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 944/1910] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:35.792473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:35.806459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c53c4-e7c0-4dc6-9274-887f23570f45 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.813078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e17e-583d-465a-9ae5-d2459884a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.814193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e17e-583d-465a-9ae5-d2459884a72a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.814477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e17e-583d-465a-9ae5-d2459884a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.814754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e17e-583d-465a-9ae5-d2459884a72a admin admin] PATH_INFO: `/v3/projects/f675be38661f4914a0ce2afae1bf076a/users/1ea3e2af59a74814ac2b1fe778338451/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.817630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1e17e-583d-465a-9ae5-d2459884a72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f675be38661f4914a0ce2afae1bf076a, user_id=1ea3e2af59a74814ac2b1fe778338451, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.820920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1e17e-583d-465a-9ae5-d2459884a72a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.831274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8d3e-9f97-4519-9350-b6e0922e985b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:35.833056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 945/1911] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:35 2022] PUT /identity/v3/projects/f675be38661f4914a0ce2afae1bf076a/users/1ea3e2af59a74814ac2b1fe778338451/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:35.845477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.845765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.846085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.876417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] MFA Rules not processed for user `1ea3e2af59a74814ac2b1fe778338451`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:35.877933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:35.909480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:35.911072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:35.911433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:35.912399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] PATH_INFO: `/v3/projects/88d569962559476a825077568cc51303` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:35.913896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d569962559476a825077568cc51303)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:35.916464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:35.976772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 946/1912] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:35.989254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d569962559476a825077568cc51303', 'request_id': 'req-100fbd4a-712d-4b1d-973b-d183f2e77135'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:35.996599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d569962559476a825077568cc51303', 'request_id': 'req-100fbd4a-712d-4b1d-973b-d183f2e77135'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:36.006494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d569962559476a825077568cc51303', 'request_id': 'req-100fbd4a-712d-4b1d-973b-d183f2e77135'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:36.006649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.008213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.023314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] The token cache is being invalidate because project 88d569962559476a825077568cc51303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:36.023611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:36.024356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-100fbd4a-712d-4b1d-973b-d183f2e77135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:36.026462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 967/1913] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:35 2022] DELETE /identity/v3/projects/88d569962559476a825077568cc51303 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:36.031930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75255-a728-4bf6-9e08-3a79fcff0901 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.032220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75255-a728-4bf6-9e08-3a79fcff0901 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.032577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75255-a728-4bf6-9e08-3a79fcff0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.057201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c1b75255-a728-4bf6-9e08-3a79fcff0901 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:36.058589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c1b75255-a728-4bf6-9e08-3a79fcff0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.095554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624e0b-9402-4787-a4f3-9bbd38c47770 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.122790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 968/1914] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:36.130505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.130505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.130748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.162450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.163109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.164130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.164605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:36.164787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.165839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.166865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.174916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 969/1915] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:36.180819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.191256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad233-30b0-4921-9fff-3ca5968f52be None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.196401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.197455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.197950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.198242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.199105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:36.199418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.201037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.214082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 970/1916] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:36.218780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.235897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b37e8-a61b-4ebd-b959-6070213aa0af admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.243488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.244241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.244699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.244956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.245780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.245912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.247732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.248128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.260497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 947/1917] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:36.283051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 971/1918] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:36.287265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.299810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b786df0-896e-4b47-ade7-5470685bce19 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.386117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.388981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.395362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.396111 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.396461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.396804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.398422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.400451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.423450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 948/1919] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:36.427325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.438336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30fcc-fa82-4858-bd19-58557975b2d2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.443026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98824107-de36-437f-b385-e873410a6989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.443688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98824107-de36-437f-b385-e873410a6989 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.443969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98824107-de36-437f-b385-e873410a6989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.444244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98824107-de36-437f-b385-e873410a6989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.445744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98824107-de36-437f-b385-e873410a6989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.447468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98824107-de36-437f-b385-e873410a6989 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.454139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a37b2-4630-4f2e-b709-1dc253c4141d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.459135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.461838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 949/1920] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:36.462046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.462665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.463167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.465173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98824107-de36-437f-b385-e873410a6989 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.466364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.479353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98824107-de36-437f-b385-e873410a6989 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.484618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.485631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.485952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.486227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.486985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.488681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.500197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 950/1921] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:36.512369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.514564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb82f-5d21-45d6-ae0b-844204916357 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.519166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.520029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.520304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.520572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] PATH_INFO: `/v3/projects/22512caa3c294c4e935945a4a21fa4f4/users/da68937a1a98456787b4ab05d8f7927b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.531487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.532918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc315-220c-411e-b74f-ee072d013562 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.535012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22512caa3c294c4e935945a4a21fa4f4, user_id=da68937a1a98456787b4ab05d8f7927b, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.537627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.542440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 972/1922] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:36.553271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 951/1923] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:36 2022] PUT /identity/v3/projects/22512caa3c294c4e935945a4a21fa4f4/users/da68937a1a98456787b4ab05d8f7927b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:36.564241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.564453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.564759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.593361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] MFA Rules not processed for user `da68937a1a98456787b4ab05d8f7927b`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:36.594580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:36.670735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 973/1924] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:36.675592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.745678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314cc74-e7be-4e08-a6eb-652539f5b080 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.750676 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.751341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.751622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.751976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.752824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.754791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.785870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 952/1925] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:36.788459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.810676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe93ca-b29b-4293-b3c8-9a2df82b6105 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.886141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.886405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.886630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.887022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.887795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.890005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.910309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 974/1926] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:36 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:36.918132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.930646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94fd5-f89d-44aa-837b-56d926928b37 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.935753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.936418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.936761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.937036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.937757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.939379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.950822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 953/1927] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:36.954819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:36.965490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd712-45af-4a31-9f87-5c8942cb84d5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:36.970166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc75e2-39aa-49e2-aecf-6e76283ce420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:36.970834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc75e2-39aa-49e2-aecf-6e76283ce420 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:36.971116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc75e2-39aa-49e2-aecf-6e76283ce420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:36.971389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc75e2-39aa-49e2-aecf-6e76283ce420 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:36.972117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc75e2-39aa-49e2-aecf-6e76283ce420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:36.973706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc75e2-39aa-49e2-aecf-6e76283ce420 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:36.984276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 975/1928] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:36.988481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.000076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2c9c9-0eb7-497e-8b65-1bd59da9a4d8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.004747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.005620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.005931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.006199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] PATH_INFO: `/v3/projects/6efd313455e84f88ae16107b31848336/users/44ce1f5ee85145babffef3c0cf8d7472/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.021956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efd313455e84f88ae16107b31848336, user_id=44ce1f5ee85145babffef3c0cf8d7472, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.024815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.038795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 954/1929] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:36 2022] PUT /identity/v3/projects/6efd313455e84f88ae16107b31848336/users/44ce1f5ee85145babffef3c0cf8d7472/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:37.049981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.050280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.050568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.077722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] MFA Rules not processed for user `44ce1f5ee85145babffef3c0cf8d7472`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:37.078911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:37.145629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 976/1930] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:37.150619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.213008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efe712-b981-4a6a-ab0b-c3c3b5aa72a2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.217989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.218600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.218883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.219158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.219854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.221765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.252558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 955/1931] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:37 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:37.253527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.265245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2c96-d3e6-4e38-a504-d0156d35b650 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.322014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.322704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.322989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.323275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.323974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.326213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.349195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 977/1932] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:37 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:37.353711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.364480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421fe54-e39e-4811-9533-35651d50895a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.370319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.370998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.371281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.371565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.372294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.374008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.389633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 956/1933] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:37.390958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.403615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b3715-1a3a-4f59-a3c3-5e8789fcacf8 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.408500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.409504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.409909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.410250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] PATH_INFO: `/v3/projects/f5fed49ad8414af0aed840dcfcad9c0a/users/db61e2db5e574f43a102d9cec1226aed/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.427649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fed49ad8414af0aed840dcfcad9c0a, user_id=db61e2db5e574f43a102d9cec1226aed, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.430662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.449461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 978/1934] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:37 2022] PUT /identity/v3/projects/f5fed49ad8414af0aed840dcfcad9c0a/users/db61e2db5e574f43a102d9cec1226aed/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:37.450897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.466753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f93908-764f-4f21-8afd-33cba6e2572a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.532930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76fa7-c5ba-4519-95cb-5a267ebd9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.533834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76fa7-c5ba-4519-95cb-5a267ebd9fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.534127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76fa7-c5ba-4519-95cb-5a267ebd9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.534405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76fa7-c5ba-4519-95cb-5a267ebd9fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.536600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76fa7-c5ba-4519-95cb-5a267ebd9fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.538877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76fa7-c5ba-4519-95cb-5a267ebd9fcf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.552834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 957/1935] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:37.554122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.564714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8644642-44b8-4c32-b220-2b40cd3e5313 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.569470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.570936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.571285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.571627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] PATH_INFO: `/v3/projects/f5fed49ad8414af0aed840dcfcad9c0a/users/db61e2db5e574f43a102d9cec1226aed/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.573768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fed49ad8414af0aed840dcfcad9c0a, user_id=db61e2db5e574f43a102d9cec1226aed, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.576473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.590509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 979/1936] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:37 2022] PUT /identity/v3/projects/f5fed49ad8414af0aed840dcfcad9c0a/users/db61e2db5e574f43a102d9cec1226aed/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:37.601632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.602440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.602794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.630426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] MFA Rules not processed for user `db61e2db5e574f43a102d9cec1226aed`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:37.631636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:37.702413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 958/1937] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:37.715312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:37.771516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa21e75-c3ea-4fd8-9a91-394837b685f2 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:37.775906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:37.776556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:37.776838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:37.777118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:37.834556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:37.837204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:37.846945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 980/1938] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:43.857163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:43.858757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:43.871022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965425-6784-49b4-b3de-f70a29e38023 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:43.875889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:43.876642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:43.876816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:43.877259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:43.979003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:43.980747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:43.993720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 959/1939] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:44.762015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:44.764709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:44.877491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f9aa-76b8-4197-9c53-e795ac8600ac service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:44.888633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:44.891272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:44.891770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:44.892205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] PATH_INFO: `/v3/users/86154c7559c14eb5ba4c75916df71f42` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:44.894493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86154c7559c14eb5ba4c75916df71f42)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:44.898241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:44.900546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:44.918067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22617-f937-4abe-8411-1cbff3ab7ab7 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:44.922042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febce2f7-f1fd-4a8c-8cdb-3f2d1f99a8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:44.922907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febce2f7-f1fd-4a8c-8cdb-3f2d1f99a8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:44.923389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febce2f7-f1fd-4a8c-8cdb-3f2d1f99a8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:44.923809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febce2f7-f1fd-4a8c-8cdb-3f2d1f99a8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:44.939475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febce2f7-f1fd-4a8c-8cdb-3f2d1f99a8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:44.941412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febce2f7-f1fd-4a8c-8cdb-3f2d1f99a8f7 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:44.956180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 960/1940] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:44.987013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86154c7559c14eb5ba4c75916df71f42'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:44.988157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86154c7559c14eb5ba4c75916df71f42'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.003730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86154c7559c14eb5ba4c75916df71f42'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.019067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86154c7559c14eb5ba4c75916df71f42'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.019852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86154c7559c14eb5ba4c75916df71f42'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.041869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 981/1941] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:44 2022] DELETE /identity/v3/users/86154c7559c14eb5ba4c75916df71f42 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:45.045175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.045519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.045833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.067285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:45.068483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.135100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 961/1942] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:45.145758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:45.147346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.215217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9159-82b6-4ad3-b9e8-c92be67e55d6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:45.219141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0031-ca89-4958-b718-038cb6553a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:45.219882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0031-ca89-4958-b718-038cb6553a52 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.220227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0031-ca89-4958-b718-038cb6553a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.220570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0031-ca89-4958-b718-038cb6553a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.233115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0031-ca89-4958-b718-038cb6553a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:45.234788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0031-ca89-4958-b718-038cb6553a52 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:45.247978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 982/1943] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:45.266596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:45.268050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.280177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d6dd-e44d-4a55-a1f8-bf8b195d97c3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:45.285278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:45.286459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.286740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.287032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] PATH_INFO: `/v3/users/dd332b3dceba4024b760443ff496071c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.288329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd332b3dceba4024b760443ff496071c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:45.291265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:45.354907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd332b3dceba4024b760443ff496071c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.355752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd332b3dceba4024b760443ff496071c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.371822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd332b3dceba4024b760443ff496071c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.379228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd332b3dceba4024b760443ff496071c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.380053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd332b3dceba4024b760443ff496071c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.396477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 962/1944] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:45 2022] DELETE /identity/v3/users/dd332b3dceba4024b760443ff496071c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:45.401289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.401582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.401894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.440451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:45.442171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.516633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 983/1945] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:45.530991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:45.533412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.577022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:45.579257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.594427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f6bcf-d62c-4865-9d99-6035479883da admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:45.597662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ad28-65b9-4990-be23-1046950368b4 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:45.598667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:45.599414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.599766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.600048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.610351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:45.610773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:45.611658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.611785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:45.611944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.612251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] PATH_INFO: `/v3/projects/30f53092c11b4066b2a483f8aa8be1a0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.613492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f53092c11b4066b2a483f8aa8be1a0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:45.615431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:45.621782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 963/1946] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:45.669502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f53092c11b4066b2a483f8aa8be1a0', 'request_id': 'req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.677387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f53092c11b4066b2a483f8aa8be1a0', 'request_id': 'req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.683053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f53092c11b4066b2a483f8aa8be1a0', 'request_id': 'req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.695251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] The token cache is being invalidate because project 30f53092c11b4066b2a483f8aa8be1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:45.695689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.696357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.698211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 984/1947] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:45 2022] DELETE /identity/v3/projects/30f53092c11b4066b2a483f8aa8be1a0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:45.702028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:45.713578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823cf9b-99cf-4904-9896-187cbe97a8ee service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:45.792004 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:45.794157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:45.794521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:45.794937 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] PATH_INFO: `/v3/users/1ea3e2af59a74814ac2b1fe778338451` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:45.796384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea3e2af59a74814ac2b1fe778338451)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:45.798809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:45.872112 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea3e2af59a74814ac2b1fe778338451'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.873076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea3e2af59a74814ac2b1fe778338451'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.897565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea3e2af59a74814ac2b1fe778338451'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.905046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea3e2af59a74814ac2b1fe778338451'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.906499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea3e2af59a74814ac2b1fe778338451'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:45.929176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 964/1948] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:45 2022] DELETE /identity/v3/users/1ea3e2af59a74814ac2b1fe778338451 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:45.942471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:45.943886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:45.960041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2ff1b-4521-4ea0-b01b-da1dfbbfa73c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.035539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.036490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.036777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.037196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] PATH_INFO: `/v3/projects/4a8efc83ba80448cbc3b6c90c9b795e0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.039016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8efc83ba80448cbc3b6c90c9b795e0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.041106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.097434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8efc83ba80448cbc3b6c90c9b795e0', 'request_id': 'req-bd2190eb-0627-4e78-92d3-fb4f42bd6264'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.112298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8efc83ba80448cbc3b6c90c9b795e0', 'request_id': 'req-bd2190eb-0627-4e78-92d3-fb4f42bd6264'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.119173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8efc83ba80448cbc3b6c90c9b795e0', 'request_id': 'req-bd2190eb-0627-4e78-92d3-fb4f42bd6264'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.137614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] The token cache is being invalidate because project 4a8efc83ba80448cbc3b6c90c9b795e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:46.138250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.138970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.143835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 985/1949] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:45 2022] DELETE /identity/v3/projects/4a8efc83ba80448cbc3b6c90c9b795e0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:46.152924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.155172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.175433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3eae6-c5ed-46af-9b28-bbb825205f49 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.275868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.278876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.279173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.279453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] PATH_INFO: `/v3/users/ad5b070a6c5345d0913d0618b09c370b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.281280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5b070a6c5345d0913d0618b09c370b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.284031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.314949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.317036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.331901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2190eb-0627-4e78-92d3-fb4f42bd6264 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.344794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.346343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.346822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.347103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] PATH_INFO: `/v3/projects/f675be38661f4914a0ce2afae1bf076a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.348373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f675be38661f4914a0ce2afae1bf076a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.350517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.379885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5b070a6c5345d0913d0618b09c370b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.381498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5b070a6c5345d0913d0618b09c370b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.406681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5b070a6c5345d0913d0618b09c370b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.413768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5b070a6c5345d0913d0618b09c370b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.415160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fa207870-06e3-4840-861a-e5e59c2e8f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5b070a6c5345d0913d0618b09c370b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.426154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f675be38661f4914a0ce2afae1bf076a', 'request_id': 'req-e2eed127-678f-4d31-af4b-098c89a3db66'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.451627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 965/1950] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:46 2022] DELETE /identity/v3/users/ad5b070a6c5345d0913d0618b09c370b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:46.452018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f675be38661f4914a0ce2afae1bf076a', 'request_id': 'req-e2eed127-678f-4d31-af4b-098c89a3db66'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.452018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f675be38661f4914a0ce2afae1bf076a', 'request_id': 'req-e2eed127-678f-4d31-af4b-098c89a3db66'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.471757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] The token cache is being invalidate because project f675be38661f4914a0ce2afae1bf076a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:46.472196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.472954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e2eed127-678f-4d31-af4b-098c89a3db66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.475406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 986/1951] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:46 2022] DELETE /identity/v3/projects/f675be38661f4914a0ce2afae1bf076a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:46.483873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.484162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.484440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.505433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:46.507035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.576758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 966/1952] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:46.584864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.585155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.585439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.605999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:46.607451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.619227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 987/1953] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:46.620514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.630418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073d65-0ed1-490d-a349-7642e9ec5923 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.635619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.636310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.636599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.636921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.637580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:46.637913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.639532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.652424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 967/1954] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:46.656892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.667212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f6bf-d417-4506-91d2-a35a0b7b6d66 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.671970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.672628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.672910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.673346 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.674080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.676195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.703027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 988/1955] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:46.707274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.717822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990402-e20c-464e-9681-e80bb024d4db admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.760135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.761778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.777251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.777968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.778249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.778522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.779231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.781171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.805930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 968/1956] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:46.807240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.816696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c15d-cbe4-404d-9671-7d12c064758b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.822017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.822668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.822948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.823222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.823948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.825598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.835662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 969/1957] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:46.838250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37108-b288-48a3-bb68-000abe9f2898 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.840359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.843062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.843913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.844191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.844458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] PATH_INFO: `/v3/projects/19f5dd85cac54120aac070a453c110aa` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.845621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f5dd85cac54120aac070a453c110aa)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.847538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.850366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1cca-d3f7-40d9-9f33-0ff0f4b22b9d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.855046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.855690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.855972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.856251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.856970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.858621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.870258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 970/1958] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:46.874318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:46.884500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558fe7d-d45c-4f8b-90e3-b95d34361580 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:46.893379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f5dd85cac54120aac070a453c110aa', 'request_id': 'req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.899954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f5dd85cac54120aac070a453c110aa', 'request_id': 'req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.905139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f5dd85cac54120aac070a453c110aa', 'request_id': 'req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.917646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] The token cache is being invalidate because project 19f5dd85cac54120aac070a453c110aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:46.917974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.918613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-52e1706f-5dc7-4d0c-bf50-3fe76d1745fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:46.920173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 989/1959] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:46 2022] DELETE /identity/v3/projects/19f5dd85cac54120aac070a453c110aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:46.924960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c2e65-b60d-4710-b775-7018210e0406 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.925264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c2e65-b60d-4710-b775-7018210e0406 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.925568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c2e65-b60d-4710-b775-7018210e0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.940928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46657d81-af7b-4e0f-b746-8c72e279e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:46.942428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46657d81-af7b-4e0f-b746-8c72e279e155 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.942876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46657d81-af7b-4e0f-b746-8c72e279e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.943092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f07c2e65-b60d-4710-b775-7018210e0406 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:46.943824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46657d81-af7b-4e0f-b746-8c72e279e155 admin admin] PATH_INFO: `/v3/projects/843025c12aeb456583564d3cccd421da/users/9f2f403dda94424d91eb48c833af2b97/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.944960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f07c2e65-b60d-4710-b775-7018210e0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.959760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 990/1960] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:46.959953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46657d81-af7b-4e0f-b746-8c72e279e155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843025c12aeb456583564d3cccd421da, user_id=9f2f403dda94424d91eb48c833af2b97, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:46.962244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.962543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.962823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:46.963244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46657d81-af7b-4e0f-b746-8c72e279e155 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:46.980120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 971/1961] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:46 2022] PUT /identity/v3/projects/843025c12aeb456583564d3cccd421da/users/9f2f403dda94424d91eb48c833af2b97/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:46.983600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:46.984859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:46.990070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:46.990366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:46.990870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.018066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] MFA Rules not processed for user `9f2f403dda94424d91eb48c833af2b97`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:47.019306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:47.058444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 991/1962] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:47.063031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.072895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799fafb-1b34-48b1-a456-20cd99ed97f7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.079928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.080592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.080881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.081163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.081923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:47.082235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.084794 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.092962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 972/1963] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:47.097495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.098902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:47.100638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 992/1964] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:47.101655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.113159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf4292-4df6-4edd-a9d5-b890bf09a035 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.114757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782025-1ab4-43ba-ab90-0e4247d61a46 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.119073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.119742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.120188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.120462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.121209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.121723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.121946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.122175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.122454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.123142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.124034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.125029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.151618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 993/1965] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:47.153955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 973/1966] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/projects => generated 407 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:47.155671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.156229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.216455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bef1-fb44-4570-b91e-a12f53bb8ca8 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.217899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3e9ed-e916-40ac-8536-ecc515865596 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.221114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.221784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.222115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.222396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.222571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.223097 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.223229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.223513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.223789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.224468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.225115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.226428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.249015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 974/1967] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/users => generated 310 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:47.249287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 994/1968] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:47.250097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.250700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.261525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481eed-02bf-46b4-9526-71e2fa96d0da admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.261695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85eac-f958-4699-a173-397d9debfc77 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.268037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.268760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.268989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.269263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.270026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.271617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.274300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.274969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.275251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.275528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.276258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.277952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.283497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 975/1969] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:47.287573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.288594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 995/1970] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:47.293254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.297389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b3a3-50c0-4027-a227-64ac12a01c4f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.302197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.302808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddb02-70f9-42ef-ac90-1a5a58641569 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.303115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.303393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.303669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] PATH_INFO: `/v3/projects/d9ac19ad14754431aed9af7433cfba0f/users/805aaac97b6c44228ae06d43cbf7a1e2/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.308763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.309692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.310006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.310307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.311034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.312624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.319354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ac19ad14754431aed9af7433cfba0f, user_id=805aaac97b6c44228ae06d43cbf7a1e2, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.322641 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.324004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 996/1971] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:47.327899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.337980 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6790-bd11-430d-92bb-aca4b15bda88 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.340541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 976/1972] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:47 2022] PUT /identity/v3/projects/d9ac19ad14754431aed9af7433cfba0f/users/805aaac97b6c44228ae06d43cbf7a1e2/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:47.349113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.415187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c41b7-a3e2-4f48-9a85-cec9977034a8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.417492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eaae1-67df-4ee1-abe1-0d38338a4bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.418885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eaae1-67df-4ee1-abe1-0d38338a4bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.419199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eaae1-67df-4ee1-abe1-0d38338a4bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.419431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eaae1-67df-4ee1-abe1-0d38338a4bbc admin admin] PATH_INFO: `/v3/projects/6c0fc345376e4f2fb473113f99fb354c/users/e4332858e665440c93d769e033ed5a92/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.420435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.421678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.421968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.422291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.423145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.424803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.438031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eaae1-67df-4ee1-abe1-0d38338a4bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0fc345376e4f2fb473113f99fb354c, user_id=e4332858e665440c93d769e033ed5a92, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.438584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 977/1973] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:47.440818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eaae1-67df-4ee1-abe1-0d38338a4bbc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.442532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.454168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3829-dd1a-4fd1-aebf-14db6ced4236 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.455675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 997/1974] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:47 2022] PUT /identity/v3/projects/6c0fc345376e4f2fb473113f99fb354c/users/e4332858e665440c93d769e033ed5a92/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:47.467527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.468510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.468829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.521252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] MFA Rules not processed for user `e4332858e665440c93d769e033ed5a92`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:47.522398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:47.524898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d505c-8af4-405d-9ce8-f34b602b46d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.525818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d505c-8af4-405d-9ce8-f34b602b46d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.526195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d505c-8af4-405d-9ce8-f34b602b46d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.526423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d505c-8af4-405d-9ce8-f34b602b46d2 admin admin] PATH_INFO: `/v3/projects/d9ac19ad14754431aed9af7433cfba0f/users/805aaac97b6c44228ae06d43cbf7a1e2/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.529095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d505c-8af4-405d-9ce8-f34b602b46d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ac19ad14754431aed9af7433cfba0f, user_id=805aaac97b6c44228ae06d43cbf7a1e2, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.532093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d505c-8af4-405d-9ce8-f34b602b46d2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.547096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 978/1975] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:47 2022] PUT /identity/v3/projects/d9ac19ad14754431aed9af7433cfba0f/users/805aaac97b6c44228ae06d43cbf7a1e2/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:47.559695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.560003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.560275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.600091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] MFA Rules not processed for user `805aaac97b6c44228ae06d43cbf7a1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:47.602095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:47.613575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 998/1976] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:47.620959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.631855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfed91-2461-4835-990d-34ef34d9ada2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.701400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.702402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.702701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.702981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.703678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.705901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.725615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 979/1977] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:47.739042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 999/1978] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:47.743953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.752792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.758849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:47.760670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5d52-7678-423a-a621-4ceb90597c09 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.839076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.840253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.840689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.840962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.841669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.843220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3296-d32e-4fb3-8368-917556df3290 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.844002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.847226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.847882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.848164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.848442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.871200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 980/1979] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:47 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:47.875715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.888213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b6dec-009e-43f1-8613-5a5ea45b7e00 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.893623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.894510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.894841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.895123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.895941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.897700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.920209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 981/1980] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:47.921096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:47.933217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc537312-ad82-439c-9b6e-adbf31cf7863 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:47.934968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.936837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.939328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:47.940406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:47.940695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:47.940974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] PATH_INFO: `/v3/projects/a41163f1cd4e4776b60789b9277d9db3/users/3367deab4e104a04b6cd7e778c97aaa6/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:47.949718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1000/1981] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:47.973235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41163f1cd4e4776b60789b9277d9db3, user_id=3367deab4e104a04b6cd7e778c97aaa6, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:47.975934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:47.991720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 982/1982] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:47 2022] PUT /identity/v3/projects/a41163f1cd4e4776b60789b9277d9db3/users/3367deab4e104a04b6cd7e778c97aaa6/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:47.996371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:48.008652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b984e-7774-4df1-8589-65c2fc493097 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:48.077722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:48.079072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:48.079511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:48.079953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:48.081058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:48.083654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:48.098096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1001/1983] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:48.103586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:48.115245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fdb22-a613-4858-b614-ea0ae0edbdba admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:48.120607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808235a-c65f-40b5-961f-fd8af2109062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:48.121505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808235a-c65f-40b5-961f-fd8af2109062 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:48.122466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808235a-c65f-40b5-961f-fd8af2109062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:48.123145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808235a-c65f-40b5-961f-fd8af2109062 admin admin] PATH_INFO: `/v3/projects/a41163f1cd4e4776b60789b9277d9db3/users/3367deab4e104a04b6cd7e778c97aaa6/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:48.125221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808235a-c65f-40b5-961f-fd8af2109062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41163f1cd4e4776b60789b9277d9db3, user_id=3367deab4e104a04b6cd7e778c97aaa6, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:48.127912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808235a-c65f-40b5-961f-fd8af2109062 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:48.139621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:48.150486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 983/1984] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:48 2022] PUT /identity/v3/projects/a41163f1cd4e4776b60789b9277d9db3/users/3367deab4e104a04b6cd7e778c97aaa6/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:48.162633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:48.163384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:48.164510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:48.206267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] MFA Rules not processed for user `3367deab4e104a04b6cd7e778c97aaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:48.207868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:48.224996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1c190-67fb-4477-97f9-7a08a706bde9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:48.290344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:48.291129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:48.291518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:48.291896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:48.329564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 984/1985] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:48.370859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:48.373011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:48.384940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1002/1986] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:48.614161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:48.614161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:48.627728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc84d-5d65-4b87-8baf-ab943333d6a4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:48.633875 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:48.635063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:48.635331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:48.635685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:48.648801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:48.650458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:48.671702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 985/1987] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:49.059139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:49.060712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:49.140221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd32f-4437-48eb-b101-8a95e48cc0b4 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:49.144792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:49.145668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:49.145985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:49.146264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] PATH_INFO: `/v3/users/da68937a1a98456787b4ab05d8f7927b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:49.147484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da68937a1a98456787b4ab05d8f7927b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:49.149576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:49.177733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:49.180815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:49.197777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496912f-0d17-4222-999d-264463d1e65a service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:49.205202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:49.206258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:49.206530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:49.206798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] PATH_INFO: `/v3/users/e9de04207e9d4ce6a3b5a2ddbd09b685` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:49.208723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9de04207e9d4ce6a3b5a2ddbd09b685)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:49.211616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:49.223453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da68937a1a98456787b4ab05d8f7927b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.224512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da68937a1a98456787b4ab05d8f7927b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.240929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da68937a1a98456787b4ab05d8f7927b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.252749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da68937a1a98456787b4ab05d8f7927b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.253680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8291bc37-e877-42cf-89f3-c174a3e72ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da68937a1a98456787b4ab05d8f7927b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.270403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1003/1988] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:49 2022] DELETE /identity/v3/users/da68937a1a98456787b4ab05d8f7927b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:49.275106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:49.275566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:49.275996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:49.276285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9de04207e9d4ce6a3b5a2ddbd09b685'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.276926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9de04207e9d4ce6a3b5a2ddbd09b685'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.290558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9de04207e9d4ce6a3b5a2ddbd09b685'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.296807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:49.298178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9de04207e9d4ce6a3b5a2ddbd09b685'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.298455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:49.299886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9de04207e9d4ce6a3b5a2ddbd09b685'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.325529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 986/1989] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:49 2022] DELETE /identity/v3/users/e9de04207e9d4ce6a3b5a2ddbd09b685 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:49.381842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1004/1990] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:49.390784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:49.392256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:49.465173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813999-1b10-4474-bcf2-948e0872df13 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:49.470151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:49.470990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:49.471391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:49.471731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:49.523793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:49.525965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:49.545037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269e28-7d8d-4f5b-abc7-63fb60d64f82 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:49.584447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:49.586345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:49.616753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 987/1991] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:49.668299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:49.669867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:49.669867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:49.669867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] PATH_INFO: `/v3/projects/b91fdca8eb484a9a87df5977387d324c` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:49.672542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91fdca8eb484a9a87df5977387d324c)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:49.674647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:49.744610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91fdca8eb484a9a87df5977387d324c', 'request_id': 'req-2160b9ef-101e-4364-bb05-ba09a3003d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.752487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91fdca8eb484a9a87df5977387d324c', 'request_id': 'req-2160b9ef-101e-4364-bb05-ba09a3003d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.769006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91fdca8eb484a9a87df5977387d324c', 'request_id': 'req-2160b9ef-101e-4364-bb05-ba09a3003d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.792000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] The token cache is being invalidate because project b91fdca8eb484a9a87df5977387d324c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:49.792091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.793358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:49.798880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1005/1992] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:49 2022] DELETE /identity/v3/projects/b91fdca8eb484a9a87df5977387d324c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:49.803022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:49.818175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14691b-781d-4c01-a14f-7d7c2b0fd732 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:49.926409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:49.927348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:49.927626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:49.927952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] PATH_INFO: `/v3/users/2ecf8980d36e47b5ae46c83047f71aaf` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:49.929335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecf8980d36e47b5ae46c83047f71aaf)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:49.931621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:49.988230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:49.990416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.011880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b9ef-101e-4364-bb05-ba09a3003d37 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.031888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.032790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.033074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.033354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] PATH_INFO: `/v3/projects/22512caa3c294c4e935945a4a21fa4f4` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.034758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22512caa3c294c4e935945a4a21fa4f4)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.036827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.051558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecf8980d36e47b5ae46c83047f71aaf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.053377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecf8980d36e47b5ae46c83047f71aaf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.076667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecf8980d36e47b5ae46c83047f71aaf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.084753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecf8980d36e47b5ae46c83047f71aaf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.086087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecf8980d36e47b5ae46c83047f71aaf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.109187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 988/1993] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:49 2022] DELETE /identity/v3/users/2ecf8980d36e47b5ae46c83047f71aaf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:50.134826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22512caa3c294c4e935945a4a21fa4f4', 'request_id': 'req-2401803f-4602-48fa-abb5-d623d67ad35c'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.141527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22512caa3c294c4e935945a4a21fa4f4', 'request_id': 'req-2401803f-4602-48fa-abb5-d623d67ad35c'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.147364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22512caa3c294c4e935945a4a21fa4f4', 'request_id': 'req-2401803f-4602-48fa-abb5-d623d67ad35c'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.166728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] The token cache is being invalidate because project 22512caa3c294c4e935945a4a21fa4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:50.167030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.167694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.169426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1006/1994] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:49 2022] DELETE /identity/v3/projects/22512caa3c294c4e935945a4a21fa4f4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:50.173532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.174944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.254857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a147-355f-4871-94fb-8fe5d948eeb7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.302606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.306764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.353719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.354684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.354879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.355595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] PATH_INFO: `/v3/users/44ce1f5ee85145babffef3c0cf8d7472` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.356761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ce1f5ee85145babffef3c0cf8d7472)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.358994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.413418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ce1f5ee85145babffef3c0cf8d7472'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.414474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ce1f5ee85145babffef3c0cf8d7472'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.414851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401803f-4602-48fa-abb5-d623d67ad35c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.419565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.420513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.420801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.421159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] PATH_INFO: `/v3/projects/9a433d28c5874cdf9854d0e5692add98` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.422525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a433d28c5874cdf9854d0e5692add98)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.424419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.426690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ce1f5ee85145babffef3c0cf8d7472'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.434287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ce1f5ee85145babffef3c0cf8d7472'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.435162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ce1f5ee85145babffef3c0cf8d7472'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.450661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 989/1995] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:50 2022] DELETE /identity/v3/users/44ce1f5ee85145babffef3c0cf8d7472 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:50.451577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.453354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.491299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a433d28c5874cdf9854d0e5692add98', 'request_id': 'req-01c7b750-f956-4aa8-b90f-4850c784f20a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.499962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a433d28c5874cdf9854d0e5692add98', 'request_id': 'req-01c7b750-f956-4aa8-b90f-4850c784f20a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.505694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a433d28c5874cdf9854d0e5692add98', 'request_id': 'req-01c7b750-f956-4aa8-b90f-4850c784f20a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.519036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] The token cache is being invalidate because project 9a433d28c5874cdf9854d0e5692add98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:50.519836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.520511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-01c7b750-f956-4aa8-b90f-4850c784f20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.525694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1007/1996] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:50 2022] DELETE /identity/v3/projects/9a433d28c5874cdf9854d0e5692add98 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:50.527521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc1ec-a415-42aa-b688-427fd4ad232f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.527809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc1ec-a415-42aa-b688-427fd4ad232f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.528152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc1ec-a415-42aa-b688-427fd4ad232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.535575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3292-5509-419d-86e5-ba3ecc05c482 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.549467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-17efc1ec-a415-42aa-b688-427fd4ad232f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:50.550738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-17efc1ec-a415-42aa-b688-427fd4ad232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.608106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.609128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.609549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.609851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] PATH_INFO: `/v3/users/e4332858e665440c93d769e033ed5a92` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.622962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4332858e665440c93d769e033ed5a92)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.624862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.626685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1008/1997] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:50.628189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.628582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.628931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.647805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:50.650832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.661120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1009/1998] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:50.665963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.677480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eacb3-4c63-4a1a-bf77-afe34c40b7b0 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.683627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.684407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.684518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4332858e665440c93d769e033ed5a92'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.684875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.685117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4332858e665440c93d769e033ed5a92'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.685333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.686246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:50.686806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.688367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.698373 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4332858e665440c93d769e033ed5a92'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.700896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1010/1999] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:50.705452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4332858e665440c93d769e033ed5a92'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.706163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.706331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-debdaabc-812c-4651-8af0-bcc62f17559c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4332858e665440c93d769e033ed5a92'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.707868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.721025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28e9bc-28cd-4f0d-830e-8013dddbc3c6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.721455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 990/2000] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:50 2022] DELETE /identity/v3/users/e4332858e665440c93d769e033ed5a92 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:50.726818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.727296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.727561 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.750492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:50.751692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.813203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.814004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.814354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.814816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.815493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.817393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.843167 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 991/2001] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:50.844218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.845514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.854472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1011/2002] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:50 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:50.855367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.857040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:50.860880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15270-5ee7-4e93-8b2c-01784f7a0b76 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.917706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576af3-d1ff-4337-b393-8919cc6d15bc admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.918738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.919604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.919885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.920164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] PATH_INFO: `/v3/projects/6efd313455e84f88ae16107b31848336` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.921317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efd313455e84f88ae16107b31848336)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.921456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.922135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.922419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.922700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.923282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.933229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.934825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.945626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1012/2003] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:50.946595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:50.956046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf946-5839-4409-bb3a-b6d1d6674255 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:50.963145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:50.963896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:50.964168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:50.964453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:50.965150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:50.967152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:50.977644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efd313455e84f88ae16107b31848336', 'request_id': 'req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.984657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efd313455e84f88ae16107b31848336', 'request_id': 'req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.993221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1013/2004] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:50 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:50.993400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efd313455e84f88ae16107b31848336', 'request_id': 'req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:50.994420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.010303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73272-b288-4646-97e6-8650741c332a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.014799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] The token cache is being invalidate because project 6efd313455e84f88ae16107b31848336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:51.015305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.015984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.017723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 992/2005] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:50 2022] DELETE /identity/v3/projects/6efd313455e84f88ae16107b31848336 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:51.021429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.022858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.081425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.082136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.082421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.082703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.083425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.085013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.104392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1014/2006] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:51.104808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57632-c5bb-4589-9e7b-e1a0d0e39b29 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.105620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.107035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.109661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.110564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.110843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.111118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] PATH_INFO: `/v3/users/db61e2db5e574f43a102d9cec1226aed` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.112423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db61e2db5e574f43a102d9cec1226aed)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.117842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.126533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c207afe-cab5-441c-a97b-c9dfc98aec67 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.132272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.133713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.134155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.134364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.138560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.141546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.156667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1015/2007] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:51.162406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.173203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e6d81-e6c2-4c28-a72c-8a6187b32acd admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.178767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c8f18-c640-4964-a494-59859e7bb447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.181317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c8f18-c640-4964-a494-59859e7bb447 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.181765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c8f18-c640-4964-a494-59859e7bb447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.182293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c8f18-c640-4964-a494-59859e7bb447 admin admin] PATH_INFO: `/v3/projects/4555fd562c634167943cc3f1445d8571/users/e0ccc3fadfe94fe29e68fd1fa065d99f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.184582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db61e2db5e574f43a102d9cec1226aed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.185434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db61e2db5e574f43a102d9cec1226aed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.200384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db61e2db5e574f43a102d9cec1226aed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.201035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c8f18-c640-4964-a494-59859e7bb447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4555fd562c634167943cc3f1445d8571, user_id=e0ccc3fadfe94fe29e68fd1fa065d99f, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.204156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c8f18-c640-4964-a494-59859e7bb447 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.208976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db61e2db5e574f43a102d9cec1226aed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.209754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db61e2db5e574f43a102d9cec1226aed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.221074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1016/2008] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:51 2022] PUT /identity/v3/projects/4555fd562c634167943cc3f1445d8571/users/e0ccc3fadfe94fe29e68fd1fa065d99f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:51.230697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 993/2009] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:51 2022] DELETE /identity/v3/users/db61e2db5e574f43a102d9cec1226aed => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:51.232653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.232941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.233220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.259642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] MFA Rules not processed for user `e0ccc3fadfe94fe29e68fd1fa065d99f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:51.260853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.302831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.305394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.347421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1017/2010] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:51.363987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.367831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.402711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea433-bddb-46af-a80c-29680bec2d45 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.415735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.416756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.417040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.417312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] PATH_INFO: `/v3/projects/6c0fc345376e4f2fb473113f99fb354c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.418554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0fc345376e4f2fb473113f99fb354c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.420456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.461226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e02be-008a-49b2-a41b-26e82bc437df None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.468376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.468929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.469222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.469504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.480592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0fc345376e4f2fb473113f99fb354c', 'request_id': 'req-c57b414f-4595-42f2-b2a8-31aa293ad30e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.482694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.484154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.487636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0fc345376e4f2fb473113f99fb354c', 'request_id': 'req-c57b414f-4595-42f2-b2a8-31aa293ad30e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.494699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1018/2011] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:51.494861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0fc345376e4f2fb473113f99fb354c', 'request_id': 'req-c57b414f-4595-42f2-b2a8-31aa293ad30e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.509748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] The token cache is being invalidate because project 6c0fc345376e4f2fb473113f99fb354c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:51.510079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.512319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.514024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 994/2012] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:51 2022] DELETE /identity/v3/projects/6c0fc345376e4f2fb473113f99fb354c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:51.518046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.529922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51245-40c8-4435-9753-7377924dd481 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.600986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.602706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.602995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.603412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] PATH_INFO: `/v3/users/3367deab4e104a04b6cd7e778c97aaa6` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.604739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3367deab4e104a04b6cd7e778c97aaa6)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.609351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.609537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.609617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.621403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b414f-4595-42f2-b2a8-31aa293ad30e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.626695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.627563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.627844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.628256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] PATH_INFO: `/v3/projects/f5fed49ad8414af0aed840dcfcad9c0a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.629469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fed49ad8414af0aed840dcfcad9c0a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.631418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.669551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3367deab4e104a04b6cd7e778c97aaa6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.670526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3367deab4e104a04b6cd7e778c97aaa6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.686555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fed49ad8414af0aed840dcfcad9c0a', 'request_id': 'req-30e5ecf4-76dc-48b8-b49b-b73257e814f7'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.689279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3367deab4e104a04b6cd7e778c97aaa6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.693321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fed49ad8414af0aed840dcfcad9c0a', 'request_id': 'req-30e5ecf4-76dc-48b8-b49b-b73257e814f7'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.696647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3367deab4e104a04b6cd7e778c97aaa6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.697405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-73d353f8-35f1-4bb9-a1a0-3f2797e4a44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3367deab4e104a04b6cd7e778c97aaa6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.699230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fed49ad8414af0aed840dcfcad9c0a', 'request_id': 'req-30e5ecf4-76dc-48b8-b49b-b73257e814f7'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.711811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1019/2013] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:51 2022] DELETE /identity/v3/users/3367deab4e104a04b6cd7e778c97aaa6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:51.714484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] The token cache is being invalidate because project f5fed49ad8414af0aed840dcfcad9c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:51.718190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.719193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-30e5ecf4-76dc-48b8-b49b-b73257e814f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:51.720954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 995/2014] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:51 2022] DELETE /identity/v3/projects/f5fed49ad8414af0aed840dcfcad9c0a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:51.725969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.727225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.728089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.750456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:51.751687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.851060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1020/2015] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:51.854368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.854871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.855365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.896882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:51.899941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:51.913179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 996/2016] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:51.917417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.928597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef2a2e-c6ac-4799-aac0-f018f62185e6 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.933578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.934350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.934711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.935093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.935831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:51.936142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.937764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:51.951479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1021/2017] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:51.955514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:51.966294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465a7af-06a0-4729-915c-9bf7066fcc52 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:51.971012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:51.971851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:51.972126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:51.972396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:51.973092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:51.975011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.000943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 997/2018] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:51 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:52.005203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.016820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953937-c328-4b28-86cb-d0ee82683f5f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.039659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.041494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.080975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.081651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.081978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.082254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.082955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.084895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.106680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1022/2019] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:52.108713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36983cd-a16b-4ac4-976e-6a371b126be3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.110544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.113544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.114432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.114715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.114990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] PATH_INFO: `/v3/projects/a41163f1cd4e4776b60789b9277d9db3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.116424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41163f1cd4e4776b60789b9277d9db3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.118478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.121016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32642e-1cd4-4391-93a3-177b31e12cfc admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.125669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.126357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.126644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.126923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.127650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.129225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.139797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1023/2020] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:52.143593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.155080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7dac0-c098-4c94-8de6-709a321a52cf admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.169259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41163f1cd4e4776b60789b9277d9db3', 'request_id': 'req-2c42bc70-3557-4a8c-85c8-24225c07a154'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:52.176904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41163f1cd4e4776b60789b9277d9db3', 'request_id': 'req-2c42bc70-3557-4a8c-85c8-24225c07a154'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:52.183743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41163f1cd4e4776b60789b9277d9db3', 'request_id': 'req-2c42bc70-3557-4a8c-85c8-24225c07a154'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:52.197443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] The token cache is being invalidate because project a41163f1cd4e4776b60789b9277d9db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:52.197736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:52.198404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c42bc70-3557-4a8c-85c8-24225c07a154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:52.200018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 998/2021] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:52 2022] DELETE /identity/v3/projects/a41163f1cd4e4776b60789b9277d9db3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:52.204588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.204874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.205148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.218756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe89e8-6be1-41c4-b1e7-1506d37b3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.219439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe89e8-6be1-41c4-b1e7-1506d37b3132 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.219728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe89e8-6be1-41c4-b1e7-1506d37b3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.220008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe89e8-6be1-41c4-b1e7-1506d37b3132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.220739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe89e8-6be1-41c4-b1e7-1506d37b3132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.222372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe89e8-6be1-41c4-b1e7-1506d37b3132 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.223158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:52.224345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.232214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 999/2022] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:52.232506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1024/2023] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:52.236408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.237708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.239597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.239885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.240164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.249693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f405-2dc9-45e1-abd0-a4657065aa23 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.254345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82030c9-88de-43e8-91e3-f0eca84a2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.255248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82030c9-88de-43e8-91e3-f0eca84a2cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.255556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82030c9-88de-43e8-91e3-f0eca84a2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.255826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82030c9-88de-43e8-91e3-f0eca84a2cdc admin admin] PATH_INFO: `/v3/projects/7a222d25964f4c6b8b7d56199b07ad27/users/dc45fe7e71534e138b78b43d3984c44c/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.258786 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:52.259978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.268071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1025/2024] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:52.270509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82030c9-88de-43e8-91e3-f0eca84a2cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a222d25964f4c6b8b7d56199b07ad27, user_id=dc45fe7e71534e138b78b43d3984c44c, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.272001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.273728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82030c9-88de-43e8-91e3-f0eca84a2cdc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.281829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75635-4b82-420f-a046-d99d9b7b5aac None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.286773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1000/2025] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:52 2022] PUT /identity/v3/projects/7a222d25964f4c6b8b7d56199b07ad27/users/dc45fe7e71534e138b78b43d3984c44c/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:52.297469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.297857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.298162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.327621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] MFA Rules not processed for user `dc45fe7e71534e138b78b43d3984c44c`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:52.329896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.343697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.344363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.344642 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.344942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.345727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:52.346068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.347741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.359672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1026/2026] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:52.363852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.375181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586267cd-612f-4fb1-87f7-d0abe5aafd1d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.379855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.380516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.380800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.381070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.381754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.384482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.401210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1001/2027] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:27:52.412697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.414216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.416488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1027/2028] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:52.420374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.474039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18091-3a00-4b64-9fb2-e0e2a06c4ac3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.498640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c7c56-d50a-44d7-9c6d-21b43c5a8b39 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.503463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.504130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.504411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.504687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.505410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.508053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.521921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.522567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.522851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.523155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.527583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1028/2029] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:52.531660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.540937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c840-83d2-4c96-b705-2329047c0a0e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.546305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.546955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.547237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.547511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.548229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.549817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.560065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1029/2030] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:52.564057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.574368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbab20-941d-4524-b9ff-70e91f8b97f9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.578927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d906b-2b03-4ee6-82fa-9bff9256d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.579613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d906b-2b03-4ee6-82fa-9bff9256d610 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.579895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d906b-2b03-4ee6-82fa-9bff9256d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.580169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d906b-2b03-4ee6-82fa-9bff9256d610 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.580713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.580908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d906b-2b03-4ee6-82fa-9bff9256d610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.582226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.582501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d906b-2b03-4ee6-82fa-9bff9256d610 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.591413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1002/2031] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:52.593837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1030/2032] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:52.597048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.607372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abb7ef-4969-4367-a4b8-bf9e92a2b64e service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.611886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.612749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.613031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.613307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] PATH_INFO: `/v3/projects/e1c32fb0e4824b149e83d3d48ea667eb/users/c2818781698448c09e1f97855fba241e/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.628421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c32fb0e4824b149e83d3d48ea667eb, user_id=c2818781698448c09e1f97855fba241e, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.631006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.644685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1003/2033] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:52 2022] PUT /identity/v3/projects/e1c32fb0e4824b149e83d3d48ea667eb/users/c2818781698448c09e1f97855fba241e/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:27:52.656340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.656650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.656931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.684193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] MFA Rules not processed for user `c2818781698448c09e1f97855fba241e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:52.686203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:52.754611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1031/2034] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:52.759276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.820584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ceeee-efc3-425f-977e-8d797f3e44f2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.826038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.826806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.827092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.827370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.828075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.830070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.864026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1004/2035] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:52.864763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.884510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa644a6-0c41-412c-ad52-93129744c931 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.945768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.946050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.946332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.946608 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.947301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.949207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:52.971717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1032/2036] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:52 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:52.972860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:52.983780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe069f2-6e3d-4d61-bf0e-e5ef34950e48 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:52.988689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:52.989348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:52.989634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:52.989941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:52.990666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:52.993419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.003934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1005/2037] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:53.008189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:53.017911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc3502-8ed9-470e-bbfb-e192fefd5851 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:53.022417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:53.023335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.023617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.023899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] PATH_INFO: `/v3/projects/c550666c8de04cb9a69894d7585cda7f/users/977b5817955245e4b97879b3fd00c367/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.038168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c550666c8de04cb9a69894d7585cda7f, user_id=977b5817955245e4b97879b3fd00c367, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:53.041375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.053197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1033/2038] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:53 2022] PUT /identity/v3/projects/c550666c8de04cb9a69894d7585cda7f/users/977b5817955245e4b97879b3fd00c367/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:53.057927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:53.067467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c2f23-4023-47e7-b37a-f58b539f231f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:53.120737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4bfd-e5f4-4464-a2d2-d3cd65c7eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:53.121395 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4bfd-e5f4-4464-a2d2-d3cd65c7eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.121674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4bfd-e5f4-4464-a2d2-d3cd65c7eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.121982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4bfd-e5f4-4464-a2d2-d3cd65c7eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.122698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4bfd-e5f4-4464-a2d2-d3cd65c7eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:53.124275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4bfd-e5f4-4464-a2d2-d3cd65c7eb8a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.134091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1006/2039] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:53.138197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:53.148658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30e1f-4055-449f-880d-643001c45927 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:53.153104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:53.154000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.154276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.154549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] PATH_INFO: `/v3/projects/c550666c8de04cb9a69894d7585cda7f/users/977b5817955245e4b97879b3fd00c367/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.156718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c550666c8de04cb9a69894d7585cda7f, user_id=977b5817955245e4b97879b3fd00c367, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:53.159477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.170273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1034/2040] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:53 2022] PUT /identity/v3/projects/c550666c8de04cb9a69894d7585cda7f/users/977b5817955245e4b97879b3fd00c367/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:53.180425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.180749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.181035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.206756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] MFA Rules not processed for user `977b5817955245e4b97879b3fd00c367`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:53.207990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:53.274298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1007/2041] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:53.285624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:53.287311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:53.342188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0b2a9-0f00-4ccc-8662-a81660c18b87 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:53.345783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16702-a72b-47bf-ba73-436472268e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:53.346441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16702-a72b-47bf-ba73-436472268e94 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.346717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16702-a72b-47bf-ba73-436472268e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.346989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16702-a72b-47bf-ba73-436472268e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.356465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16702-a72b-47bf-ba73-436472268e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:53.358040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16702-a72b-47bf-ba73-436472268e94 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.368710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1035/2042] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:53.443456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:53.508506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870162-d41b-4b47-9ffc-5a99d9f91312 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:53.513087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:53.513994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.514275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.514547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] PATH_INFO: `/v3/users/c2818781698448c09e1f97855fba241e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.515752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2818781698448c09e1f97855fba241e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:53.517645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.562612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2818781698448c09e1f97855fba241e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:53.563258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2818781698448c09e1f97855fba241e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:53.575115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2818781698448c09e1f97855fba241e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:53.581607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2818781698448c09e1f97855fba241e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:53.582282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2818781698448c09e1f97855fba241e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:53.594942 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1008/2043] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:53 2022] DELETE /identity/v3/users/c2818781698448c09e1f97855fba241e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:53.599505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.599791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.600065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.617322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:53.618584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:53.678242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1036/2044] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:53.687795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:53.689468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:53.745996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e72d-00f1-49bc-95a6-0e43535a2cbc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:53.749553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:53.750228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:53.750511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:53.750786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:53.761175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:53.762721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:53.772526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1009/2045] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:54.077667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:54.079172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:54.091785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f673-c896-48a2-b2c8-d191dfc02bbd None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:54.096664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:54.097525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:54.097833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:54.098118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] PATH_INFO: `/v3/projects/e1c32fb0e4824b149e83d3d48ea667eb` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:54.099340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c32fb0e4824b149e83d3d48ea667eb)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:54.101288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:54.157885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c32fb0e4824b149e83d3d48ea667eb', 'request_id': 'req-b0beef7e-7098-438f-8902-01b23b4e4996'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.164842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c32fb0e4824b149e83d3d48ea667eb', 'request_id': 'req-b0beef7e-7098-438f-8902-01b23b4e4996'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.171197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c32fb0e4824b149e83d3d48ea667eb', 'request_id': 'req-b0beef7e-7098-438f-8902-01b23b4e4996'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.185266 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] The token cache is being invalidate because project e1c32fb0e4824b149e83d3d48ea667eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:54.185561 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.186227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.188358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1037/2046] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:54 2022] DELETE /identity/v3/projects/e1c32fb0e4824b149e83d3d48ea667eb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:54.192731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:54.203929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e431-b483-44fb-a7f5-83306934cf86 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:54.270293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:54.271178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:54.271459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:54.271735 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] PATH_INFO: `/v3/users/977b5817955245e4b97879b3fd00c367` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:54.272968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977b5817955245e4b97879b3fd00c367)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:54.274904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:54.327004 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977b5817955245e4b97879b3fd00c367'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.327660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977b5817955245e4b97879b3fd00c367'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.340743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977b5817955245e4b97879b3fd00c367'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.348811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977b5817955245e4b97879b3fd00c367'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.349549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-000e1454-5c16-4c5c-aea5-a47e11a1b647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977b5817955245e4b97879b3fd00c367'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.369680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1010/2047] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:54 2022] DELETE /identity/v3/users/977b5817955245e4b97879b3fd00c367 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:54.739501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:54.741439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:54.755939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beef7e-7098-438f-8902-01b23b4e4996 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:54.823509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:54.824489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:54.824834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:54.825166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] PATH_INFO: `/v3/projects/c550666c8de04cb9a69894d7585cda7f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:54.826427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c550666c8de04cb9a69894d7585cda7f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:54.828332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:54.874326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c550666c8de04cb9a69894d7585cda7f', 'request_id': 'req-0da42469-e760-4502-9430-43b9141d1c6b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.880228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c550666c8de04cb9a69894d7585cda7f', 'request_id': 'req-0da42469-e760-4502-9430-43b9141d1c6b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.886022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c550666c8de04cb9a69894d7585cda7f', 'request_id': 'req-0da42469-e760-4502-9430-43b9141d1c6b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.899146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] The token cache is being invalidate because project c550666c8de04cb9a69894d7585cda7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:54.899525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.900155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-0da42469-e760-4502-9430-43b9141d1c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:54.902018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1038/2048] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:54 2022] DELETE /identity/v3/projects/c550666c8de04cb9a69894d7585cda7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:54.906727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:54.907215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:54.907312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:54.925671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:54.926840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:54.987753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1011/2049] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:54.996687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:54.996978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:54.997257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.016817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:55.018047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:55.028301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1039/2050] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:55.033456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.043477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73455ab-0950-4f1d-bdb9-0efe8eb662ea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.048118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.048773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.049057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.049333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.050259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:55.050507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.052284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.064562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1012/2051] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:27:55.068953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.078500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46d27a-99ca-4bd8-b818-65e8d48a31d2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.083379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.084025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.084304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.084572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.085428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.088128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.116706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1040/2052] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:55 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:55.117782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.127596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfccc79-be70-417b-9a7e-36eb68b09c69 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.181739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.182360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.182640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.182912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.183593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.185479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.204480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1013/2053] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:55 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:55.208573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.219160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f41f2c-e287-41be-8945-ec1b426ecfd6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.223860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.224518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.224829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.225105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.225861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.227474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.237674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1041/2054] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:55.241965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.252543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb55b41-8cae-44dc-bbed-dfa6d9b96c5e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.257690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084c187-01fa-49ba-9aed-a680e8e738c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.258705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084c187-01fa-49ba-9aed-a680e8e738c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.258990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084c187-01fa-49ba-9aed-a680e8e738c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.259271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084c187-01fa-49ba-9aed-a680e8e738c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.260177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084c187-01fa-49ba-9aed-a680e8e738c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.261776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084c187-01fa-49ba-9aed-a680e8e738c6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.272150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1014/2055] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:55.276937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.286518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f041c-c072-4ab6-be67-738d7569cc28 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.291265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.292133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.292415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.292690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] PATH_INFO: `/v3/projects/f0453cdcaf534eecb2756d97e6f0a792/users/a4e99feb13be4e5bbcaeadba8f45bee7/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.307217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0453cdcaf534eecb2756d97e6f0a792, user_id=a4e99feb13be4e5bbcaeadba8f45bee7, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.309818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.323712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1042/2056] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:55 2022] PUT /identity/v3/projects/f0453cdcaf534eecb2756d97e6f0a792/users/a4e99feb13be4e5bbcaeadba8f45bee7/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:55.333912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.334207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.334491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.360149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] MFA Rules not processed for user `a4e99feb13be4e5bbcaeadba8f45bee7`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:55.361337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:55.425013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1015/2057] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:55.430174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.494788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9373-56ba-4d8e-b3a0-b7519cbe2da6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.499406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.500100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.500388 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.500726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.501430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.503364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.528696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1043/2058] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:55 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:55.532683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.543090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7bf5b-21d6-4ad3-a2b1-60f8e2c0e9bc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.597690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.598385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.598669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.598946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.599649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.601785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.622544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1016/2059] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:55 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:55.626519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.637085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134317f-ef2d-43f2-a12b-3f80a26a16e9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.641589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.642272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.642553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.642828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.643543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.645155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.655283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1044/2060] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:55.659258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.669152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bcf94-b25f-428b-ba5b-e636ec00f70e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.673758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.674656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.674939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.675222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] PATH_INFO: `/v3/projects/f4878442b0f54dff85f0b687a8236ab9/users/84a4230e9183426a99a977a823ddfc58/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.690094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4878442b0f54dff85f0b687a8236ab9, user_id=84a4230e9183426a99a977a823ddfc58, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.692822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.706909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1017/2061] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:55 2022] PUT /identity/v3/projects/f4878442b0f54dff85f0b687a8236ab9/users/84a4230e9183426a99a977a823ddfc58/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:55.710790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.720784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd8c87-d324-4003-8d64-b3d4b33104f6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.775880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ada5b-3973-40fe-961e-fbf58cbaf232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.776540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ada5b-3973-40fe-961e-fbf58cbaf232 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.776823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ada5b-3973-40fe-961e-fbf58cbaf232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.777102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ada5b-3973-40fe-961e-fbf58cbaf232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.777843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ada5b-3973-40fe-961e-fbf58cbaf232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.779428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ada5b-3973-40fe-961e-fbf58cbaf232 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.789293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1045/2062] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:55.793505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.803469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730707a-ec54-44bc-97b6-05caeef1901c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:55.808971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:55.809857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.810161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.810432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] PATH_INFO: `/v3/projects/f4878442b0f54dff85f0b687a8236ab9/users/84a4230e9183426a99a977a823ddfc58/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.812362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4878442b0f54dff85f0b687a8236ab9, user_id=84a4230e9183426a99a977a823ddfc58, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:55.815028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:55.824896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1018/2063] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:55 2022] PUT /identity/v3/projects/f4878442b0f54dff85f0b687a8236ab9/users/84a4230e9183426a99a977a823ddfc58/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:55.834828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:55.835112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:55.835453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:55.860878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] MFA Rules not processed for user `84a4230e9183426a99a977a823ddfc58`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:55.862115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:55.928767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1046/2064] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:55.940367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:55.942195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:55.999383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee506-e727-4961-a280-6c4e0b8e1a14 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:56.003025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:56.003670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:56.003949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:56.004223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:56.013240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:56.014701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:56.024243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1019/2065] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:56.113600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:56.115457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:56.128079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdfa5a-0a4c-467b-bacc-3bf7864f3aac None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:56.131747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231da92-eccd-4360-8a53-6680f9fce4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:56.132496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231da92-eccd-4360-8a53-6680f9fce4cd service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:56.132916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231da92-eccd-4360-8a53-6680f9fce4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:56.133291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231da92-eccd-4360-8a53-6680f9fce4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:56.192352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231da92-eccd-4360-8a53-6680f9fce4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:56.193841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231da92-eccd-4360-8a53-6680f9fce4cd service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:56.202772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1047/2066] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:27:58.281827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:58.283248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:58.351696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19e283-17ad-4b3f-93e5-9d6678f7ac96 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:58.356632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:58.357539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:58.357844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:58.358132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] PATH_INFO: `/v3/users/dc45fe7e71534e138b78b43d3984c44c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:58.359362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc45fe7e71534e138b78b43d3984c44c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:58.361339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:58.421489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc45fe7e71534e138b78b43d3984c44c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:58.422288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc45fe7e71534e138b78b43d3984c44c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:58.435383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc45fe7e71534e138b78b43d3984c44c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:58.442323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc45fe7e71534e138b78b43d3984c44c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:58.443034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc45fe7e71534e138b78b43d3984c44c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:58.464687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1020/2067] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:27:58 2022] DELETE /identity/v3/users/dc45fe7e71534e138b78b43d3984c44c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:58.469360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:58.469815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:58.470001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:58.497513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:58.498745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:58.579589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1048/2068] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:58.590007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:58.591559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:58.672923 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae55e-6735-4232-8144-8b1073b54e46 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:58.677136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410dde6-155b-4787-b093-2f923e1ccb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:58.678025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410dde6-155b-4787-b093-2f923e1ccb83 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:58.678314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410dde6-155b-4787-b093-2f923e1ccb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:58.678598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410dde6-155b-4787-b093-2f923e1ccb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:58.691468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410dde6-155b-4787-b093-2f923e1ccb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:58.698394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410dde6-155b-4787-b093-2f923e1ccb83 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:58.709323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1021/2069] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:27:59.133012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.134759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:59.149534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ad81f-2d63-4d2a-8741-f0cb3fe1686d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.164999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.165274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.165891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.166171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] PATH_INFO: `/v3/projects/7a222d25964f4c6b8b7d56199b07ad27` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.167846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a222d25964f4c6b8b7d56199b07ad27)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.169853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.218409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a222d25964f4c6b8b7d56199b07ad27', 'request_id': 'req-fc30f517-b503-4727-8a5b-f469c7ecd79e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:59.224324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a222d25964f4c6b8b7d56199b07ad27', 'request_id': 'req-fc30f517-b503-4727-8a5b-f469c7ecd79e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:59.230773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a222d25964f4c6b8b7d56199b07ad27', 'request_id': 'req-fc30f517-b503-4727-8a5b-f469c7ecd79e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:59.243643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] The token cache is being invalidate because project 7a222d25964f4c6b8b7d56199b07ad27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:27:59.243938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:59.244613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc30f517-b503-4727-8a5b-f469c7ecd79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:27:59.246243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1049/2070] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:27:59 2022] DELETE /identity/v3/projects/7a222d25964f4c6b8b7d56199b07ad27 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:59.251458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.251973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.252586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.274815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:59.276031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:59.337280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1022/2071] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:59.344979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.345272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.345559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.364476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:59.365657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:59.374166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1050/2072] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:59.378270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.388112 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0d0a-2e1f-4cbb-a81c-4997568ae65e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.393280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.394031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.394334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.394673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.395378 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:27:59.395686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.397509 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.410336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1023/2073] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:27:59.416587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.426589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9074d-a511-4aa8-bdba-5e36f06872a0 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.431840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.432509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.432797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.433071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.433767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.435699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.464940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1051/2074] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:27:59 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:27:59.469230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.480222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77408687-27e7-47a7-b653-1c4fe69c2653 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.545139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.545979 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.546289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.546636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.547363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.549427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.573192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1024/2075] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:27:59 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:27:59.578072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.594995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47590a-1fc2-41bb-a331-7ca110d31bc9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.600602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.601909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.602452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.603437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.603773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.605895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.617551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1052/2076] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:27:59.621620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.631763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f20e-75d2-4952-91de-77c4ddcbd797 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.643701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9652dc7-ee3b-4670-9680-b6492b077b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.644482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9652dc7-ee3b-4670-9680-b6492b077b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.644832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9652dc7-ee3b-4670-9680-b6492b077b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.645823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9652dc7-ee3b-4670-9680-b6492b077b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.646647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9652dc7-ee3b-4670-9680-b6492b077b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.649224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9652dc7-ee3b-4670-9680-b6492b077b11 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.661040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1025/2077] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:27:59.665371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.679589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352ac7e-4cfa-4961-94de-df43acdab8bf admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.684748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.685785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.686200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.686566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] PATH_INFO: `/v3/projects/cda18f88f1e14cf5b249eb019249eab0/users/1ff5d576859b4a568ce76c0d98e3a613/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.703609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda18f88f1e14cf5b249eb019249eab0, user_id=1ff5d576859b4a568ce76c0d98e3a613, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.706278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.725658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1053/2078] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:27:59 2022] PUT /identity/v3/projects/cda18f88f1e14cf5b249eb019249eab0/users/1ff5d576859b4a568ce76c0d98e3a613/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:27:59.737301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.737603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.737892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.764590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] MFA Rules not processed for user `1ff5d576859b4a568ce76c0d98e3a613`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:27:59.766095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:59.835827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1026/2079] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:27:59.851153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:27:59.852945 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:27:59.919192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660a94-2871-42c3-8a63-ab0985f443d5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:27:59.923487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4531296-7365-4ff5-b6b3-f7bff92c6664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:27:59.924282 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531296-7365-4ff5-b6b3-f7bff92c6664 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:27:59.924598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531296-7365-4ff5-b6b3-f7bff92c6664 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:27:59.924879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531296-7365-4ff5-b6b3-f7bff92c6664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:27:59.935240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531296-7365-4ff5-b6b3-f7bff92c6664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:27:59.936854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531296-7365-4ff5-b6b3-f7bff92c6664 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:27:59.947172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1054/2080] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:27:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:00.314003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:00.316308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:00.411438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bb91a-8eac-4d40-a180-c8714df7c940 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:00.417258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:00.418249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:00.418900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:00.419388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] PATH_INFO: `/v3/users/9f2f403dda94424d91eb48c833af2b97` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:00.420835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2f403dda94424d91eb48c833af2b97)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:00.422994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:00.505739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2f403dda94424d91eb48c833af2b97'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:00.507673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2f403dda94424d91eb48c833af2b97'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:00.521723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2f403dda94424d91eb48c833af2b97'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:00.532841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2f403dda94424d91eb48c833af2b97'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:00.533621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2f403dda94424d91eb48c833af2b97'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:00.563306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1027/2081] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:00 2022] DELETE /identity/v3/users/9f2f403dda94424d91eb48c833af2b97 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:00.567735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682385-5c36-4b66-ac90-813d8990867f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:00.568032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682385-5c36-4b66-ac90-813d8990867f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:00.568339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682385-5c36-4b66-ac90-813d8990867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:00.588501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-78682385-5c36-4b66-ac90-813d8990867f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:00.589769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-78682385-5c36-4b66-ac90-813d8990867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:00.659581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1055/2082] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:00.670119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:00.671519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:00.731779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77665818-3be1-416a-8d58-8683d33cb976 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:00.735687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:00.736441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:00.736988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:00.737304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:00.748984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:00.750533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:00.761102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1028/2083] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:28:01.053207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682385-5c36-4b66-ac90-813d8990867f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:01.055595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-78682385-5c36-4b66-ac90-813d8990867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:01.073376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682385-5c36-4b66-ac90-813d8990867f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:01.078659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:01.086464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:01.086831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:01.087291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] PATH_INFO: `/v3/projects/843025c12aeb456583564d3cccd421da` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:01.092915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843025c12aeb456583564d3cccd421da)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:01.095577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:01.151502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843025c12aeb456583564d3cccd421da', 'request_id': 'req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.157969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843025c12aeb456583564d3cccd421da', 'request_id': 'req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.164227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843025c12aeb456583564d3cccd421da', 'request_id': 'req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.178121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] The token cache is being invalidate because project 843025c12aeb456583564d3cccd421da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:01.178492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.179223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.181024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1056/2084] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:01 2022] DELETE /identity/v3/projects/843025c12aeb456583564d3cccd421da => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:01.185106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:01.197730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970e99-cb60-420a-bce8-824f588cb04d service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:01.268589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:01.269516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:01.269867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:01.270150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] PATH_INFO: `/v3/users/805aaac97b6c44228ae06d43cbf7a1e2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:01.271474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=805aaac97b6c44228ae06d43cbf7a1e2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:01.274172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:01.324144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805aaac97b6c44228ae06d43cbf7a1e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.324791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805aaac97b6c44228ae06d43cbf7a1e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.336318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805aaac97b6c44228ae06d43cbf7a1e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.342964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805aaac97b6c44228ae06d43cbf7a1e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.343638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805aaac97b6c44228ae06d43cbf7a1e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.356428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1029/2085] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:01 2022] DELETE /identity/v3/users/805aaac97b6c44228ae06d43cbf7a1e2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:01.586727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:01.588474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:01.603575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9e2b-4d46-419a-8d89-7eca621e3c57 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:01.681315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:01.683572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:01.723365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:01.727101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:01.727533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:01.728418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] PATH_INFO: `/v3/users/e0ccc3fadfe94fe29e68fd1fa065d99f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:01.730095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ccc3fadfe94fe29e68fd1fa065d99f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:01.732165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:01.763174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcecf-d277-4f52-9e7c-e4babcbe90ab admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:01.769961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:01.771132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:01.771818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:01.773866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] PATH_INFO: `/v3/projects/d9ac19ad14754431aed9af7433cfba0f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:01.775435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ac19ad14754431aed9af7433cfba0f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:01.777555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:01.810084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ccc3fadfe94fe29e68fd1fa065d99f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.810976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ccc3fadfe94fe29e68fd1fa065d99f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.832011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ccc3fadfe94fe29e68fd1fa065d99f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.833349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ac19ad14754431aed9af7433cfba0f', 'request_id': 'req-abf8e904-4a79-4fd3-a283-8855484fc839'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.840703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ac19ad14754431aed9af7433cfba0f', 'request_id': 'req-abf8e904-4a79-4fd3-a283-8855484fc839'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.842699 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ccc3fadfe94fe29e68fd1fa065d99f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.843583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-75d7b55e-4420-4fbc-b56f-5564254ba699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ccc3fadfe94fe29e68fd1fa065d99f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.850145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ac19ad14754431aed9af7433cfba0f', 'request_id': 'req-abf8e904-4a79-4fd3-a283-8855484fc839'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.862494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1057/2086] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:01 2022] DELETE /identity/v3/users/e0ccc3fadfe94fe29e68fd1fa065d99f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:01.871032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:01.871536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:01.871838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:01.878757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] The token cache is being invalidate because project d9ac19ad14754431aed9af7433cfba0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:01.879146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.879945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-abf8e904-4a79-4fd3-a283-8855484fc839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:01.881759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1030/2087] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:01 2022] DELETE /identity/v3/projects/d9ac19ad14754431aed9af7433cfba0f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:01.889771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886646a-e5cf-4fbe-8e8a-d430868471ef None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:01.889925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886646a-e5cf-4fbe-8e8a-d430868471ef None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:01.890175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886646a-e5cf-4fbe-8e8a-d430868471ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:01.907077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:01.908444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:01.922480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c886646a-e5cf-4fbe-8e8a-d430868471ef None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:01.924027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c886646a-e5cf-4fbe-8e8a-d430868471ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:01.977169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1058/2088] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:01.990870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:01.993440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.013833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1031/2089] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:02.018927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.019763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.020210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.042586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:02.043867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.052702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1032/2090] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:02.057692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.061133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ec43c-8f6f-4c0a-9e0d-ca4d8dcdd8aa None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.065188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.066023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.066373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.066684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.067804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611f81-f723-45f3-9aea-d6350723665d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.073047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.074041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.074325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.084638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.084638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:02.084638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.084893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.084983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.085597 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.088899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1059/2091] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:02.091949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1033/2092] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:02.096041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.105913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b73d2-7e4e-47e0-a1c8-1556ab207378 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.110744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.111435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.111718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.111992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.112687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.114614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.144572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1060/2093] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:02.149943 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.160311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558753df-a886-4303-a499-d139ab7be704 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.225202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.226504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.226780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.227206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.227912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.230088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.264888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1034/2094] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:02.270021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.281616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f899a-e5e2-4a95-8b40-0091a80045f5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.287796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.289254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.289744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.290467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.291435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.293129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.306197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1061/2095] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:02.311583 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.323706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b998c6f-e5c3-40f4-bc1d-de672f431ed6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.329388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.330177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.330363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.330644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.331381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.333316 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.345677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1035/2096] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:02.349993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.363196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098c83-586c-4245-bb0f-c63a456230ac admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.368809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2ffc-12aa-43c6-8147-17a2f6681e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.370431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2ffc-12aa-43c6-8147-17a2f6681e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.370431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2ffc-12aa-43c6-8147-17a2f6681e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.370740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2ffc-12aa-43c6-8147-17a2f6681e72 admin admin] PATH_INFO: `/v3/projects/283a02de86064293ae34aecde4380f31/users/7116101511974129b31232185b5c0cf9/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.409488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2ffc-12aa-43c6-8147-17a2f6681e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283a02de86064293ae34aecde4380f31, user_id=7116101511974129b31232185b5c0cf9, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.412447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2ffc-12aa-43c6-8147-17a2f6681e72 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.418287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.420510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.441841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1062/2097] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:02 2022] PUT /identity/v3/projects/283a02de86064293ae34aecde4380f31/users/7116101511974129b31232185b5c0cf9/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:02.442027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47310fb-6147-4840-98ca-40f74329405c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.451303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.454948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.456253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.498093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] MFA Rules not processed for user `7116101511974129b31232185b5c0cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:02.499316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.515367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.516345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.516688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.517070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] PATH_INFO: `/v3/projects/4555fd562c634167943cc3f1445d8571` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.518343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4555fd562c634167943cc3f1445d8571)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.520423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.575695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4555fd562c634167943cc3f1445d8571', 'request_id': 'req-5002c54d-d9d3-4695-aebb-034bc013f898'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.576128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1063/2098] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:02.577036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.579031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.582542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4555fd562c634167943cc3f1445d8571', 'request_id': 'req-5002c54d-d9d3-4695-aebb-034bc013f898'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.588657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4555fd562c634167943cc3f1445d8571', 'request_id': 'req-5002c54d-d9d3-4695-aebb-034bc013f898'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.593249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda1226-21ca-43ae-9c2b-d50c536f4b42 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.602094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] The token cache is being invalidate because project 4555fd562c634167943cc3f1445d8571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:02.602403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.603056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.604791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1036/2099] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:02 2022] DELETE /identity/v3/projects/4555fd562c634167943cc3f1445d8571 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:02.605857 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.607467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.654587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.655468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.655754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.656033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] PATH_INFO: `/v3/users/a4e99feb13be4e5bbcaeadba8f45bee7` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.657236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e99feb13be4e5bbcaeadba8f45bee7)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.659283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.675073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c54d-d9d3-4695-aebb-034bc013f898 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.681998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635799b-76e0-460b-88fe-18331d4445c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.682718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635799b-76e0-460b-88fe-18331d4445c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.683004 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635799b-76e0-460b-88fe-18331d4445c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.683336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635799b-76e0-460b-88fe-18331d4445c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.684148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635799b-76e0-460b-88fe-18331d4445c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.686534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635799b-76e0-460b-88fe-18331d4445c0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.710777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e99feb13be4e5bbcaeadba8f45bee7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.711587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e99feb13be4e5bbcaeadba8f45bee7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.714286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1037/2100] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:02.715552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce087-88d8-4a50-8871-7eb0e04a5be0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.715860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce087-88d8-4a50-8871-7eb0e04a5be0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.716161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce087-88d8-4a50-8871-7eb0e04a5be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.723718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e99feb13be4e5bbcaeadba8f45bee7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.732617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e99feb13be4e5bbcaeadba8f45bee7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.733709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e99feb13be4e5bbcaeadba8f45bee7'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:02.736034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-19dce087-88d8-4a50-8871-7eb0e04a5be0 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:02.737273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-19dce087-88d8-4a50-8871-7eb0e04a5be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.752483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1064/2101] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:02 2022] DELETE /identity/v3/users/a4e99feb13be4e5bbcaeadba8f45bee7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:02.753301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.754774 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.807341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1038/2102] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:02.808985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e804-0ab1-403d-81b1-c0ceebd0bd77 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.809365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e804-0ab1-403d-81b1-c0ceebd0bd77 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.809703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e804-0ab1-403d-81b1-c0ceebd0bd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.825919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7bd4-0bae-431f-a8c4-f3b1114f0887 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.826714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-88e9e804-0ab1-403d-81b1-c0ceebd0bd77 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:02.827899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-88e9e804-0ab1-403d-81b1-c0ceebd0bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.830568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.831235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.831524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.831799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.832489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.834441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.836106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1039/2103] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:02.840117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.840117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.840117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.856631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1065/2104] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:02.857444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.859394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.868035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:02.869229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:02.877478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1040/2105] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:02.878351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.888716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc704ba9-6701-48cd-bca6-b91ac0a6084f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.893531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.894229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.894514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.894793 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.895564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.897172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.909079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1041/2106] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:02.910009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.918951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389ba2-2c32-4706-9e27-f56d6a454250 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.920677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73f96-ad64-4748-aa8c-9a57873b2689 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.922640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.923284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.923570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.923849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.925533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.926211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.926537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.926854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.929831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:02.929831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.930196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.933685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.935179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.946619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1042/2107] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:02.946619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.948083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1066/2108] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:02.948779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:02.958013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c8f3-24af-4484-9342-6bcc878b622f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.958319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab06b8-1ad7-4ca6-ac5f-d65442acd4dc service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:02.963775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.964468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.964731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.964877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:02.965033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.965689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.965850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:02.966133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:02.966637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] PATH_INFO: `/v3/projects/1445dc36200449ef9b0ba00e5f7f574a/users/50885276a5b84ae48a4cec095f2c65fa/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:02.968207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:02.996416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1445dc36200449ef9b0ba00e5f7f574a, user_id=50885276a5b84ae48a4cec095f2c65fa, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:02.999166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.012326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1067/2109] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:02 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:03.012326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.020394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1043/2110] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:02 2022] PUT /identity/v3/projects/1445dc36200449ef9b0ba00e5f7f574a/users/50885276a5b84ae48a4cec095f2c65fa/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:03.025130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.107732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a60f11-d3e8-4a48-94d9-64abd690dc6d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.120464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920a4ba-9d1c-49dd-af45-5994a2d47687 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.126067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.126796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.127084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.127362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.128200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.129907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.153994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1044/2111] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:28:03.157830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.170440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211559a-d6b8-4307-9ccd-60ff843df80d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.180655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c49f20-9dce-4cba-8492-f76cfff159fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.181561 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c49f20-9dce-4cba-8492-f76cfff159fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.181901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c49f20-9dce-4cba-8492-f76cfff159fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.182196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c49f20-9dce-4cba-8492-f76cfff159fb admin admin] PATH_INFO: `/v3/projects/1445dc36200449ef9b0ba00e5f7f574a/users/50885276a5b84ae48a4cec095f2c65fa/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.184223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c49f20-9dce-4cba-8492-f76cfff159fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1445dc36200449ef9b0ba00e5f7f574a, user_id=50885276a5b84ae48a4cec095f2c65fa, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.187265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c49f20-9dce-4cba-8492-f76cfff159fb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.196375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.197769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.198091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.198365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.199673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.205840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1045/2112] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:03 2022] PUT /identity/v3/projects/1445dc36200449ef9b0ba00e5f7f574a/users/50885276a5b84ae48a4cec095f2c65fa/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:03.206148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.214240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.214885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.215376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.243136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1068/2113] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:03 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:03.246963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.254940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] MFA Rules not processed for user `50885276a5b84ae48a4cec095f2c65fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:03.256139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.260658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05388-aaae-4d04-a9be-7dc49fa4bff3 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.330826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.331884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.332331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.333082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.334101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.337513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.351895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1069/2114] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:03.352665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.356909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.365307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1046/2115] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:03.370639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.377673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80130-3e2b-45f3-9e1e-d6377c171545 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.385557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.386077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b58e98-710b-41df-a2d3-e5c24fbc89de None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.387007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.387491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.387933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] PATH_INFO: `/v3/projects/f0453cdcaf534eecb2756d97e6f0a792` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.389394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0453cdcaf534eecb2756d97e6f0a792)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.391881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.392235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.392645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.392927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.393206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.394103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.395791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.411000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1047/2116] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:03.411000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.411240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.512450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0453cdcaf534eecb2756d97e6f0a792', 'request_id': 'req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.520152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0453cdcaf534eecb2756d97e6f0a792', 'request_id': 'req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.522015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a55cc-4201-4a1e-95df-9dc1be0e1e12 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.548537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0453cdcaf534eecb2756d97e6f0a792', 'request_id': 'req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.568659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] The token cache is being invalidate because project f0453cdcaf534eecb2756d97e6f0a792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:03.568975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.575686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.581596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1070/2117] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:03 2022] DELETE /identity/v3/projects/f0453cdcaf534eecb2756d97e6f0a792 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:03.582935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.584613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.610265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.610998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.611361 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.611711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.614678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.662900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8e71-977a-4e7b-a78b-c88ffefbeb5b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.672199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aab2b-3836-4534-ad51-7845d55b3a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.673095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aab2b-3836-4534-ad51-7845d55b3a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.673411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aab2b-3836-4534-ad51-7845d55b3a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.673692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aab2b-3836-4534-ad51-7845d55b3a2a admin admin] PATH_INFO: `/v3/projects/8626f5eac340484a910f15799f9575e8/users/9c98690769c94fbfa9d67b5e3cb4648f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.687949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.689514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.689993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603aab2b-3836-4534-ad51-7845d55b3a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8626f5eac340484a910f15799f9575e8, user_id=9c98690769c94fbfa9d67b5e3cb4648f, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.692714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603aab2b-3836-4534-ad51-7845d55b3a2a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.701393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1048/2118] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:03.702861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.706513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.711868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1071/2119] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:03 2022] PUT /identity/v3/projects/8626f5eac340484a910f15799f9575e8/users/9c98690769c94fbfa9d67b5e3cb4648f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:03.722278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.722644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b782fc-f339-4fa2-b173-a5f9c1bcbcd6 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:03.722761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.722850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.759694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] MFA Rules not processed for user `9c98690769c94fbfa9d67b5e3cb4648f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:03.761661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.818906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:03.820807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:03.821299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:03.821990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] PATH_INFO: `/v3/users/84a4230e9183426a99a977a823ddfc58` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:03.823114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a4230e9183426a99a977a823ddfc58)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:03.825872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:03.885668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1072/2120] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:03.902312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a4230e9183426a99a977a823ddfc58'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.905067 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a4230e9183426a99a977a823ddfc58'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.921093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a4230e9183426a99a977a823ddfc58'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.922992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:03.924886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:03.930357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a4230e9183426a99a977a823ddfc58'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.931522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a4230e9183426a99a977a823ddfc58'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:03.961196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1049/2121] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:03 2022] DELETE /identity/v3/users/84a4230e9183426a99a977a823ddfc58 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:04.029511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285e795-de43-4eb4-921a-b93dfcb3a556 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.103613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.104392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.104737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.105073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.107058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.188342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:04.190810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.209421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.212054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.224033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1073/2122] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:28:04.248099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:04.249656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.302477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e191c-6fc8-495d-b309-944bd597446a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.308632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.309841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.310165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.310517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] PATH_INFO: `/v3/users/7116101511974129b31232185b5c0cf9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.311929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7116101511974129b31232185b5c0cf9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.314082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.339607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f4d9c-f700-4aad-b52a-28eb0abcfe69 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.345080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.346301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.346577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.346808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] PATH_INFO: `/v3/users/9c98690769c94fbfa9d67b5e3cb4648f` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.348410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c98690769c94fbfa9d67b5e3cb4648f)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.351447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.372403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7116101511974129b31232185b5c0cf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.373055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7116101511974129b31232185b5c0cf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.384753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7116101511974129b31232185b5c0cf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.391474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7116101511974129b31232185b5c0cf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.392217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7116101511974129b31232185b5c0cf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.404435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c98690769c94fbfa9d67b5e3cb4648f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.405127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c98690769c94fbfa9d67b5e3cb4648f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.406905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1050/2123] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:04 2022] DELETE /identity/v3/users/7116101511974129b31232185b5c0cf9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:04.410055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:04.410055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.420633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c98690769c94fbfa9d67b5e3cb4648f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.427286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c98690769c94fbfa9d67b5e3cb4648f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.427979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c98690769c94fbfa9d67b5e3cb4648f'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.447092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1074/2124] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:04 2022] DELETE /identity/v3/users/9c98690769c94fbfa9d67b5e3cb4648f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:04.450670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:04.452064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.477350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5a231-005c-447c-b805-b98fb5c27134 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.527273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499356c-a41f-401f-936f-0acfb1a42e14 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.532149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.533009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.533296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.533576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] PATH_INFO: `/v3/projects/f4878442b0f54dff85f0b687a8236ab9` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.534694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.534839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4878442b0f54dff85f0b687a8236ab9)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.535576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.535861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.536139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] PATH_INFO: `/v3/users/bdf0ad3b9d3040e882cc75085370cf19` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.536795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.537531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf0ad3b9d3040e882cc75085370cf19)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.541494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.598723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf0ad3b9d3040e882cc75085370cf19'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.599332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf0ad3b9d3040e882cc75085370cf19'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.601370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4878442b0f54dff85f0b687a8236ab9', 'request_id': 'req-890e35ba-98f5-4729-b771-511f862fea25'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.608915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4878442b0f54dff85f0b687a8236ab9', 'request_id': 'req-890e35ba-98f5-4729-b771-511f862fea25'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.612132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf0ad3b9d3040e882cc75085370cf19'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.614747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4878442b0f54dff85f0b687a8236ab9', 'request_id': 'req-890e35ba-98f5-4729-b771-511f862fea25'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.628697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf0ad3b9d3040e882cc75085370cf19'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.628697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-428daee9-74f0-4ebb-81e1-46511801f0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf0ad3b9d3040e882cc75085370cf19'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.635177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] The token cache is being invalidate because project f4878442b0f54dff85f0b687a8236ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:04.635667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.636546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-890e35ba-98f5-4729-b771-511f862fea25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:04.638678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1075/2125] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:04 2022] DELETE /identity/v3/projects/f4878442b0f54dff85f0b687a8236ab9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:04.640055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.640349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.640629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.642631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1051/2126] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:04 2022] DELETE /identity/v3/users/bdf0ad3b9d3040e882cc75085370cf19 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:04.644289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e346a0-4a4e-4435-a6ce-91e8f1ddf2d3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.644756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e346a0-4a4e-4435-a6ce-91e8f1ddf2d3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.645004 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e346a0-4a4e-4435-a6ce-91e8f1ddf2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.674425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:04.677328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.686809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e0e346a0-4a4e-4435-a6ce-91e8f1ddf2d3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:04.688012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e0e346a0-4a4e-4435-a6ce-91e8f1ddf2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.788928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1052/2127] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:04.790849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.791310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.791752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.800076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1076/2128] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:04.812915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:04.814889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.822402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:04.823715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.832586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1053/2129] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:04.833734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:04.835367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:04.888735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857869d8-be9d-47c1-a147-4bef6caa63f7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.893505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ddcb2-1091-45c5-ac16-8e5894b20f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.906281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ddcb2-1091-45c5-ac16-8e5894b20f78 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.906281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ddcb2-1091-45c5-ac16-8e5894b20f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.906281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ddcb2-1091-45c5-ac16-8e5894b20f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.919727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42971b96-ba11-4d84-97de-8bc9fe9fd53f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:04.923994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:04.924794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.925174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.925551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.938781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ddcb2-1091-45c5-ac16-8e5894b20f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.938781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ddcb2-1091-45c5-ac16-8e5894b20f78 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.949666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1077/2130] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:28:04.951050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:04.952064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:04.953516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:04.954180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:04.954466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:04.978755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1054/2131] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:04.985543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:04.986956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.001459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.006888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1078/2132] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:05.013155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9f8a-178c-422a-a029-368982c4a304 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.032290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.033244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.033421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.033820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.034668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:05.034983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.036663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.077847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1055/2133] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:05.088651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.105572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eeda4-a41b-433e-aff8-74b734851320 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.119418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.120502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.121236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.121617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.122728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.125150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.172140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.174579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1079/2134] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:05 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:05.189197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea98931-d63c-4fef-a3d4-02613e65c038 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.209617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.213351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.300503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.301500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.302221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.302688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.304681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.308639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.344265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1056/2135] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:05 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:05.345541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.346809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0a293-1cae-4152-bf90-d5ce4180b869 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.359091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.359987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.360259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.360750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] PATH_INFO: `/v3/projects/0856aad5f2a04ad5aacde0070bbca853` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.362088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468ad04-dcc8-431b-8e36-3067f3b00276 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.364739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0856aad5f2a04ad5aacde0070bbca853)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.367441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.372079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.374030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.374410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.375068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.376122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.380517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.414843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1057/2136] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:05.430455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.442300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.446904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0856aad5f2a04ad5aacde0070bbca853', 'request_id': 'req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.456081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0856aad5f2a04ad5aacde0070bbca853', 'request_id': 'req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.464192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0856aad5f2a04ad5aacde0070bbca853', 'request_id': 'req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.466029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97a26-dccf-4a6d-a64e-3515bd34b7b2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.480539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] The token cache is being invalidate because project 0856aad5f2a04ad5aacde0070bbca853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:05.480915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.490027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.490027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1080/2137] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:05 2022] DELETE /identity/v3/projects/0856aad5f2a04ad5aacde0070bbca853 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:05.490027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.490027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.575267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.576482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.576774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.577054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] PATH_INFO: `/v3/projects/283a02de86064293ae34aecde4380f31` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.578691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283a02de86064293ae34aecde4380f31)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.579093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a7566-ab57-4bd1-8dad-84fe3944fca8 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.581161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.594616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61e24-5481-4d8e-b1c5-9e4e83126766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.595375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61e24-5481-4d8e-b1c5-9e4e83126766 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.595863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61e24-5481-4d8e-b1c5-9e4e83126766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.595863 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61e24-5481-4d8e-b1c5-9e4e83126766 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.596621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61e24-5481-4d8e-b1c5-9e4e83126766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.598301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61e24-5481-4d8e-b1c5-9e4e83126766 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.609220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1081/2138] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:05.610641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.610936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.611216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.633488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:05.634692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.640302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283a02de86064293ae34aecde4380f31', 'request_id': 'req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.650655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283a02de86064293ae34aecde4380f31', 'request_id': 'req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.659199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283a02de86064293ae34aecde4380f31', 'request_id': 'req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.674207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] The token cache is being invalidate because project 283a02de86064293ae34aecde4380f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:05.674533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.675218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.678223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1058/2139] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:05 2022] DELETE /identity/v3/projects/283a02de86064293ae34aecde4380f31 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:05.678223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.679038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.712692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1082/2140] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:05.712692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.715120 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.738810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36194a6-c1ca-4bdf-8da1-5d777cf3d42e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.748248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.750287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.750943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.751615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] PATH_INFO: `/v3/projects/e33f805afe9e4ad687f9dbca53c6542b/users/4e6ff229155041b392dd20242a21f21d/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.769244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab15fec-7f9c-41ec-ba75-7b1a4f6b8ae1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.775528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.776441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.776788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.777071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] PATH_INFO: `/v3/projects/8626f5eac340484a910f15799f9575e8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.778100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33f805afe9e4ad687f9dbca53c6542b, user_id=4e6ff229155041b392dd20242a21f21d, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.778407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8626f5eac340484a910f15799f9575e8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.780340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.780978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.794841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1083/2141] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:05 2022] PUT /identity/v3/projects/e33f805afe9e4ad687f9dbca53c6542b/users/4e6ff229155041b392dd20242a21f21d/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:05.798631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:05.802922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.836807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8626f5eac340484a910f15799f9575e8', 'request_id': 'req-6fb6b045-8884-4e86-b099-9a08224fabe6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.847787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8626f5eac340484a910f15799f9575e8', 'request_id': 'req-6fb6b045-8884-4e86-b099-9a08224fabe6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.855359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8626f5eac340484a910f15799f9575e8', 'request_id': 'req-6fb6b045-8884-4e86-b099-9a08224fabe6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.871929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] The token cache is being invalidate because project 8626f5eac340484a910f15799f9575e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:05.872900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.873327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6fb6b045-8884-4e86-b099-9a08224fabe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:05.875231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1059/2142] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:05 2022] DELETE /identity/v3/projects/8626f5eac340484a910f15799f9575e8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:05.876441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a400fa-11fd-4605-8870-b71e090bd8fa None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.876802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a400fa-11fd-4605-8870-b71e090bd8fa None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.877158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a400fa-11fd-4605-8870-b71e090bd8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.879476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c909-7d64-4a63-9b49-a325a141abe7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:05.896262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-16a400fa-11fd-4605-8870-b71e090bd8fa None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:05.897628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-16a400fa-11fd-4605-8870-b71e090bd8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:05.956625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:05.957505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.957788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.958094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] PATH_INFO: `/v3/users/50885276a5b84ae48a4cec095f2c65fa` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:05.959661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50885276a5b84ae48a4cec095f2c65fa)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:05.961741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:05.971670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1060/2143] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:05.973519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895536c-647a-4569-9e1a-4236f768372c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:05.974315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895536c-647a-4569-9e1a-4236f768372c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:05.974836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895536c-647a-4569-9e1a-4236f768372c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.012021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f895536c-647a-4569-9e1a-4236f768372c None None] MFA Rules not processed for user `4e6ff229155041b392dd20242a21f21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:06.013205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f895536c-647a-4569-9e1a-4236f768372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.031837 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50885276a5b84ae48a4cec095f2c65fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.033209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50885276a5b84ae48a4cec095f2c65fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.048667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50885276a5b84ae48a4cec095f2c65fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.056889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50885276a5b84ae48a4cec095f2c65fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.057855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50885276a5b84ae48a4cec095f2c65fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.082559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1061/2144] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:06.083879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.084273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.084433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.086333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1084/2145] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:05 2022] DELETE /identity/v3/users/50885276a5b84ae48a4cec095f2c65fa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:06.090191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.095295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.124729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:06.126116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.203060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb3cb-d7bc-4185-ad86-5d4b9284459a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.208321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.209090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.209312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.209590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.210514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:06.210825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.212790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea53e9-d5b6-4441-bcc6-710a80330438 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.214882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1062/2146] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:06.215848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.217286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.237559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1085/2147] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:06.238960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.239254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.239536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.262054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:06.264316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.282010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1086/2148] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:06.283207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.298517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda2d3-6ccb-407c-bd79-ba7c2d2d9d45 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.308668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0640fe8-713b-4c99-821a-064c87619a27 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.315906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.318137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.318877 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.319065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.323750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.324426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.324711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.324988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.325688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.327827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.358300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1087/2149] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:06.359880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.403512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.405087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.418833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1063/2150] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:06.419787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.442638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896727-4318-403d-b150-9d288f6432e8 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.494534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91e30-dd9a-4fef-8487-755f10e8a7c3 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.501164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.501876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.502165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.502446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.503201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:06.503512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.505555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.519088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1088/2151] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:06.520145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.522313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.536795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f850-4e5a-4d0c-b472-d2192ebd6c9e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.545238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.545238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.545238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.545238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] PATH_INFO: `/v3/projects/1445dc36200449ef9b0ba00e5f7f574a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.546005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1445dc36200449ef9b0ba00e5f7f574a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.547136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.547813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.548012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.548141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.548360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.549691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.553701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.580147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1064/2152] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:06.580147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.594308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71accd-9f2b-4344-8979-e4936105e461 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.610085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1800362-fefe-429a-9388-6c99c8c1a517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.610648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1800362-fefe-429a-9388-6c99c8c1a517 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.610925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1800362-fefe-429a-9388-6c99c8c1a517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.611194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1800362-fefe-429a-9388-6c99c8c1a517 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.611499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1445dc36200449ef9b0ba00e5f7f574a', 'request_id': 'req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.611881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1800362-fefe-429a-9388-6c99c8c1a517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.613776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1800362-fefe-429a-9388-6c99c8c1a517 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.621825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1445dc36200449ef9b0ba00e5f7f574a', 'request_id': 'req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.628996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1445dc36200449ef9b0ba00e5f7f574a', 'request_id': 'req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.649666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] The token cache is being invalidate because project 1445dc36200449ef9b0ba00e5f7f574a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:06.650527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.651644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:06.658113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1089/2153] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:06 2022] DELETE /identity/v3/projects/1445dc36200449ef9b0ba00e5f7f574a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:06.658113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.658113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.659784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1065/2154] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:06.661404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.661728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.668786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.697559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:06.702612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.752234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac195-b2c9-4f83-bfe4-5d027734edfe admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.823793 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1066/2155] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:06.824485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.825812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.856659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764de3-80fb-418c-bbdd-302577c18961 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.863385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.864069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.864357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.864638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.865341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.868806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.893286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86e58a-bba0-4846-8b2e-0b8fa83ef184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.894050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e58a-bba0-4846-8b2e-0b8fa83ef184 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.894396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e58a-bba0-4846-8b2e-0b8fa83ef184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.894668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e58a-bba0-4846-8b2e-0b8fa83ef184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.895539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86e58a-bba0-4846-8b2e-0b8fa83ef184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.898143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86e58a-bba0-4846-8b2e-0b8fa83ef184 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.917758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1090/2156] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:06.919778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.920078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.920396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.921922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1067/2157] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:06.922876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.941948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7a89-4998-4fba-b1f8-c3c1c8c06449 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.945556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:06.947307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:06.948792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.949783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.950307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.950692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.951568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.954362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.967439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1091/2158] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:06.968126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.971085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1068/2159] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:06.971981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:06.980706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11d927-bb9a-46fe-83db-70d440c2b5e8 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.984484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557a190-0bba-4c13-9369-809937d4ec79 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:06.987101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.987869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.988138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.988413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.989208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.989700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:06.991247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:06.991521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:06.991893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:06.992235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:06.993276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:06.993384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:06.995127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.004720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1092/2160] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:07.009568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1069/2161] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:07.010603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.010786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.021109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f29ef4-d6c9-4316-8a3c-22c51d53bcba admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.021318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef15f7-a41c-4691-8162-33cd0c3e2af9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.027017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.027240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.027748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.028143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.028434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.028542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.028714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] PATH_INFO: `/v3/projects/bc5eea7113114071836cb1707903940f/users/f884ba846aa74480b8a7c157a527a56a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.029008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.030652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.033077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.046727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1070/2162] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:07.047661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.054676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5eea7113114071836cb1707903940f, user_id=f884ba846aa74480b8a7c157a527a56a, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.057363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.058611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830977-938f-410b-88f9-f4c04c2a3f27 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.064071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ddd59-6e58-4e7e-a8ac-9030244eea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.064815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddd59-6e58-4e7e-a8ac-9030244eea0a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.065094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddd59-6e58-4e7e-a8ac-9030244eea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.065366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddd59-6e58-4e7e-a8ac-9030244eea0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.066785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ddd59-6e58-4e7e-a8ac-9030244eea0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.068674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ddd59-6e58-4e7e-a8ac-9030244eea0a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.076632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1093/2163] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:07 2022] PUT /identity/v3/projects/bc5eea7113114071836cb1707903940f/users/f884ba846aa74480b8a7c157a527a56a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:07.077490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.098901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1071/2164] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:07.100256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.100981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.101254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.121121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:07.123187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:07.145523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5b35-72f0-4e8f-99cb-c95779c6caee admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.186078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1072/2165] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:07.187299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.197226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc87b6-5f5b-48ec-8400-f4cc316446b7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.202589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.203253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.203533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.203810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.204497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.206563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.212217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.213393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.213896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.214537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] PATH_INFO: `/v3/projects/78da9627c63b4c0a8da2bf742ecc4db3/users/7b3ea574aed3451c8869d9cee25e33c4/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.230101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1073/2166] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:07.232488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.236008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:07.237024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78da9627c63b4c0a8da2bf742ecc4db3, user_id=7b3ea574aed3451c8869d9cee25e33c4, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.239935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.255064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1094/2167] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:07 2022] PUT /identity/v3/projects/78da9627c63b4c0a8da2bf742ecc4db3/users/7b3ea574aed3451c8869d9cee25e33c4/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:07.265296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.300240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404107f-7898-4aa5-b244-65e87491b1b2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.340928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb44c8-4c88-45de-997f-7c7ac00cc0c5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.346338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeebcae-752d-4c30-a4cb-f9cbad8b7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.347025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeebcae-752d-4c30-a4cb-f9cbad8b7471 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.347308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeebcae-752d-4c30-a4cb-f9cbad8b7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.347585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeebcae-752d-4c30-a4cb-f9cbad8b7471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.348567 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeebcae-752d-4c30-a4cb-f9cbad8b7471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.350228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeebcae-752d-4c30-a4cb-f9cbad8b7471 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.355163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.356602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.357141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.357444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.362211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1095/2168] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:07.367038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.367331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.367616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.369819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.371530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.390851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1074/2169] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:07.392389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.407374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1c67-659c-42e9-9a88-48a9befcc170 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.412475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] MFA Rules not processed for user `7b3ea574aed3451c8869d9cee25e33c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:07.415069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:07.415406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.416157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.416511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.416870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.417674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.419647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.440819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1075/2170] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:07.442097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.464889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d768-821d-46d5-bbae-2249e00fe84b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.485100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0bf5d-d52f-44a7-9681-d98f516fd577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.486205 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0bf5d-d52f-44a7-9681-d98f516fd577 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.486492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0bf5d-d52f-44a7-9681-d98f516fd577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.486775 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0bf5d-d52f-44a7-9681-d98f516fd577 admin admin] PATH_INFO: `/v3/projects/ba4f65c4966c4a43bab1e00489a82c6c/users/a96b5b2e54f24e4da300d722bef91689/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.505832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0bf5d-d52f-44a7-9681-d98f516fd577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4f65c4966c4a43bab1e00489a82c6c, user_id=a96b5b2e54f24e4da300d722bef91689, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.508777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0bf5d-d52f-44a7-9681-d98f516fd577 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.533631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1096/2171] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:07.538659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.554697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1076/2172] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:07 2022] PUT /identity/v3/projects/ba4f65c4966c4a43bab1e00489a82c6c/users/a96b5b2e54f24e4da300d722bef91689/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:07.554928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976fe09-22de-4b16-b396-7ae57923a2af None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.557820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.558170 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.558465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.601231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] MFA Rules not processed for user `a96b5b2e54f24e4da300d722bef91689`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:07.602573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:07.630906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.632016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.633501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.633994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.635580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.638604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.677981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1097/2173] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:07.677981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.718398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1077/2174] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:07.730522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.731834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:07.746981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ddaf6-bb35-43fb-98b7-5aca89a6d0c9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.752387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.753038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.753329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.753601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.754326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.756237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.782307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1098/2175] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:07 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:07.786488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.799442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4b52d-77d6-4ab7-a53e-582bf5aafc46 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.805877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.806671 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.806991 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.807227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.807803 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad0728-d6e4-4f56-9f53-aa35a8db1615 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.807954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.809546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.823649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1099/2176] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:28:07.833117 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:07.855418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2e9b8-8804-4e1b-aea8-a1d0dbaddfb7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:07.860489 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.861517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.861814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.862090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] PATH_INFO: `/v3/projects/52a1eea8c9534552b978e7954ca808c0/users/8b0f1bca04cf4cd3b5567dc98fc997a8/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.905192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a1eea8c9534552b978e7954ca808c0, user_id=8b0f1bca04cf4cd3b5567dc98fc997a8, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:07.910225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:07.912311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:07.914077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:07.914575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:07.915007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:07.933643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1100/2177] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:07 2022] PUT /identity/v3/projects/52a1eea8c9534552b978e7954ca808c0/users/8b0f1bca04cf4cd3b5567dc98fc997a8/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:07.938808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:08.008052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:08.009519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:08.023370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1078/2178] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:08.059835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6962503-6aaa-4a3d-95f6-ddb76d94e424 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:08.066494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e64fd-da77-4be8-a4da-79f16a4dbe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:08.067389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e64fd-da77-4be8-a4da-79f16a4dbe66 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:08.067520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e64fd-da77-4be8-a4da-79f16a4dbe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:08.067811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e64fd-da77-4be8-a4da-79f16a4dbe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:08.068509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e64fd-da77-4be8-a4da-79f16a4dbe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:08.070248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e64fd-da77-4be8-a4da-79f16a4dbe66 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:08.096513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1101/2179] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:08.100329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:08.112204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026346d2-1860-4bcd-b19f-2e2b025b7e0e service glance] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:08.118868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:08.119772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:08.120057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:08.120337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] PATH_INFO: `/v3/projects/52a1eea8c9534552b978e7954ca808c0/users/8b0f1bca04cf4cd3b5567dc98fc997a8/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:08.122950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a1eea8c9534552b978e7954ca808c0, user_id=8b0f1bca04cf4cd3b5567dc98fc997a8, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:08.126777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:08.141586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1079/2180] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:08 2022] PUT /identity/v3/projects/52a1eea8c9534552b978e7954ca808c0/users/8b0f1bca04cf4cd3b5567dc98fc997a8/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:08.153172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560411-55e0-49c5-9985-d723a4bed4b2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:08.153549 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560411-55e0-49c5-9985-d723a4bed4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:08.153839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560411-55e0-49c5-9985-d723a4bed4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:08.204386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fa560411-55e0-49c5-9985-d723a4bed4b2 None None] MFA Rules not processed for user `8b0f1bca04cf4cd3b5567dc98fc997a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:08.205254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fa560411-55e0-49c5-9985-d723a4bed4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:08.340280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1102/2181] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:08.352113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:08.354306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:08.450180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83831404-3218-4391-8c38-e6c2a3c85161 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:08.456800 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a779-7e64-4af3-958c-cbb5cf5b8e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:08.457701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a779-7e64-4af3-958c-cbb5cf5b8e8a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:08.458166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a779-7e64-4af3-958c-cbb5cf5b8e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:08.458624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a779-7e64-4af3-958c-cbb5cf5b8e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:08.543758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a779-7e64-4af3-958c-cbb5cf5b8e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:08.545349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a779-7e64-4af3-958c-cbb5cf5b8e8a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:08.563816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1080/2182] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:12.032893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:12.033416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:12.033657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:12.071845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] MFA Rules not processed for user `f884ba846aa74480b8a7c157a527a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:12.073633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:12.171892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1103/2183] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:12.184576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3e94-9c75-40ee-8d3e-96150597a8fe None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:12.185686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3e94-9c75-40ee-8d3e-96150597a8fe None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:12.186456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3e94-9c75-40ee-8d3e-96150597a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:12.208563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f87f3e94-9c75-40ee-8d3e-96150597a8fe None None] MFA Rules not processed for user `f884ba846aa74480b8a7c157a527a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:12.209843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f87f3e94-9c75-40ee-8d3e-96150597a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:12.218830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1081/2184] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:12.231118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:12.232726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:12.338769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be318221-850b-4fe8-8f95-2f9d67ed7c7c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:12.344267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:12.344859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:12.345151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:12.345433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:12.354324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:12.356157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:12.365525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1104/2185] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:13.050253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9792e2-20fa-4c64-bb7b-281d5d3e35a8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:13.050499 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9792e2-20fa-4c64-bb7b-281d5d3e35a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:13.050721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9792e2-20fa-4c64-bb7b-281d5d3e35a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:13.084465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9c9792e2-20fa-4c64-bb7b-281d5d3e35a8 None None] MFA Rules not processed for user `f884ba846aa74480b8a7c157a527a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:13.085820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9c9792e2-20fa-4c64-bb7b-281d5d3e35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:13.094012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1082/2186] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:13.373237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:13.457999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447a24-7cb6-413e-9884-c8c60f937581 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:13.475182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:13.477479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:13.477985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:13.478541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] PATH_INFO: `/v3/users/7b3ea574aed3451c8869d9cee25e33c4` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:13.480411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3ea574aed3451c8869d9cee25e33c4)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:13.488197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:13.557462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3ea574aed3451c8869d9cee25e33c4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:13.558152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3ea574aed3451c8869d9cee25e33c4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:13.570987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3ea574aed3451c8869d9cee25e33c4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:13.578156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3ea574aed3451c8869d9cee25e33c4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:13.578798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3ea574aed3451c8869d9cee25e33c4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:13.602319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1105/2187] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:13 2022] DELETE /identity/v3/users/7b3ea574aed3451c8869d9cee25e33c4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:13.604952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:13.605428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:13.605698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:13.634285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:13.635718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:13.700108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1083/2188] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:13.713341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:13.714775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:13.782241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2def0-bba0-42ce-947e-a2fe01cda43c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:13.786198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:13.787043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:13.787471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:13.787985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:13.798043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:13.799789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:13.810723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1106/2189] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:14.150779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:14.152365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:14.170991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce071-1a7b-4a78-bac6-19d5574df952 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:14.175848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:14.176961 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:14.177270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:14.177543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] PATH_INFO: `/v3/projects/78da9627c63b4c0a8da2bf742ecc4db3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:14.179420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=78da9627c63b4c0a8da2bf742ecc4db3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:14.181370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:14.230154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78da9627c63b4c0a8da2bf742ecc4db3', 'request_id': 'req-1731aa91-ccfe-4d19-8789-df9e5849e4cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.237675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78da9627c63b4c0a8da2bf742ecc4db3', 'request_id': 'req-1731aa91-ccfe-4d19-8789-df9e5849e4cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.243768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78da9627c63b4c0a8da2bf742ecc4db3', 'request_id': 'req-1731aa91-ccfe-4d19-8789-df9e5849e4cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.259140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] The token cache is being invalidate because project 78da9627c63b4c0a8da2bf742ecc4db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:14.259705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.260507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.262358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1084/2190] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:14 2022] DELETE /identity/v3/projects/78da9627c63b4c0a8da2bf742ecc4db3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:14.266411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:14.276015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babc34-2cb7-4de9-81eb-f7413f972d01 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:14.355031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:14.356021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:14.356493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:14.356840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] PATH_INFO: `/v3/users/8b0f1bca04cf4cd3b5567dc98fc997a8` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:14.360301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0f1bca04cf4cd3b5567dc98fc997a8)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:14.362515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:14.419652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0f1bca04cf4cd3b5567dc98fc997a8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.421737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0f1bca04cf4cd3b5567dc98fc997a8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.437700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0f1bca04cf4cd3b5567dc98fc997a8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.447146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0f1bca04cf4cd3b5567dc98fc997a8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.447891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-a69ce084-b934-40d5-bd38-d4e98ae72e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0f1bca04cf4cd3b5567dc98fc997a8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.465914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1107/2191] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:14 2022] DELETE /identity/v3/users/8b0f1bca04cf4cd3b5567dc98fc997a8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:14.766238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:14.767882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:14.781998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731aa91-ccfe-4d19-8789-df9e5849e4cd admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:14.839042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:14.839910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:14.840188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:14.840459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] PATH_INFO: `/v3/projects/52a1eea8c9534552b978e7954ca808c0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:14.841636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a1eea8c9534552b978e7954ca808c0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:14.843562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:14.914199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a1eea8c9534552b978e7954ca808c0', 'request_id': 'req-78c29c74-dc77-42cb-8265-b3874f6d5d03'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.930438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a1eea8c9534552b978e7954ca808c0', 'request_id': 'req-78c29c74-dc77-42cb-8265-b3874f6d5d03'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.930438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a1eea8c9534552b978e7954ca808c0', 'request_id': 'req-78c29c74-dc77-42cb-8265-b3874f6d5d03'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.949463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] The token cache is being invalidate because project 52a1eea8c9534552b978e7954ca808c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:14.950209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.951289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-78c29c74-dc77-42cb-8265-b3874f6d5d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:14.953466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1085/2192] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:14 2022] DELETE /identity/v3/projects/52a1eea8c9534552b978e7954ca808c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:14.958796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:14.959081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:14.959381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:14.980445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:14.982818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:15.049348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1108/2193] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:15.057386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.057785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.058156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.079572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:15.080863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:15.089553 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1086/2194] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:15.093665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.103971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a39a-752b-4e28-be3a-1537b42ffc81 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.108722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.109408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.109688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.109995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.110726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:15.111035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.112638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.125843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1109/2195] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:15.130391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.140806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7af4-1459-4be0-90e1-3e24e0e30d87 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.147900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.148956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.149237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.149500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.150301 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.152247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.204953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1087/2196] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:15 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:28:15.209170 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.220408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7967797-c5a5-4653-9349-7a841f24d7a1 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.302775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.303702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.304056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.304335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.305153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.307798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.337981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1110/2197] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:15 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:15.342311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.353644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83e05-7e12-4fde-8f41-916ba92ac8b3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.358992 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.359721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.360071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.360414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.361227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.363082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.374952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1088/2198] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:15.378745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.389515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75923c-088c-4fb8-bdeb-8271135d93bb admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.394933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3e54e-70a8-4e2e-a1cc-4d2f64725e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.395610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e54e-70a8-4e2e-a1cc-4d2f64725e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.395892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e54e-70a8-4e2e-a1cc-4d2f64725e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.396197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3e54e-70a8-4e2e-a1cc-4d2f64725e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.396962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e54e-70a8-4e2e-a1cc-4d2f64725e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.399114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3e54e-70a8-4e2e-a1cc-4d2f64725e0a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.410084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1111/2199] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:15.414458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.424904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18d4c9-87e4-4de8-81de-3e618ebc2734 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.430136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.431018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.431299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.431575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] PATH_INFO: `/v3/projects/8f9b9eb04f9142a7882ffc5652f97390/users/90e24f4ffc0842e7ba8eb343b380ca1d/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.448075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9b9eb04f9142a7882ffc5652f97390, user_id=90e24f4ffc0842e7ba8eb343b380ca1d, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.450713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.466496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1089/2200] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:15 2022] PUT /identity/v3/projects/8f9b9eb04f9142a7882ffc5652f97390/users/90e24f4ffc0842e7ba8eb343b380ca1d/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:15.477065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.477565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.477644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.505731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] MFA Rules not processed for user `90e24f4ffc0842e7ba8eb343b380ca1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:15.507814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:15.576021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1112/2201] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:15.588159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:15.590131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:15.648398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce287c-c638-4dfb-a2ca-2867e34824fb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:15.652133 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa325e-3c3b-4618-a15b-4080c53757c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:15.652783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa325e-3c3b-4618-a15b-4080c53757c6 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:15.653065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa325e-3c3b-4618-a15b-4080c53757c6 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:15.653339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa325e-3c3b-4618-a15b-4080c53757c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:15.663315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa325e-3c3b-4618-a15b-4080c53757c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:15.664764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa325e-3c3b-4618-a15b-4080c53757c6 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:15.674396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1090/2202] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:17.426437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:17.430119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:17.565603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e73a4-1773-45e0-890b-f2e517791c99 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:17.574286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:17.576086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:17.576634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:17.577107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] PATH_INFO: `/v3/users/1ff5d576859b4a568ce76c0d98e3a613` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:17.578834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff5d576859b4a568ce76c0d98e3a613)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:17.581004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:17.641331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff5d576859b4a568ce76c0d98e3a613'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:17.642273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff5d576859b4a568ce76c0d98e3a613'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:17.655410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff5d576859b4a568ce76c0d98e3a613'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:17.663352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff5d576859b4a568ce76c0d98e3a613'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:17.664300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff5d576859b4a568ce76c0d98e3a613'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:17.683217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1113/2203] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:17 2022] DELETE /identity/v3/users/1ff5d576859b4a568ce76c0d98e3a613 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:17.688949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:17.689498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:17.689498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:17.707874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:17.709083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:17.785914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1091/2204] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:17.810428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:17.812165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:17.872879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac1d2-3691-4fee-a3b7-af07e4aed444 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:17.876873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343faad9-b1f2-426d-8e31-91a4aecc81d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:17.877582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343faad9-b1f2-426d-8e31-91a4aecc81d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:17.877900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343faad9-b1f2-426d-8e31-91a4aecc81d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:17.878181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343faad9-b1f2-426d-8e31-91a4aecc81d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:17.888723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343faad9-b1f2-426d-8e31-91a4aecc81d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:17.890435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343faad9-b1f2-426d-8e31-91a4aecc81d9 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:17.901811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1114/2205] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:18.632533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:18.634139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:18.661648 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2616b-4989-4a08-994d-e10e3c9f2ef5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:18.667446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:18.668346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:18.668574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:18.668843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] PATH_INFO: `/v3/projects/cda18f88f1e14cf5b249eb019249eab0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:18.670356 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda18f88f1e14cf5b249eb019249eab0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:18.672413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:18.773576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda18f88f1e14cf5b249eb019249eab0', 'request_id': 'req-ccc35c42-1c1c-4e35-b120-17b53da58515'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:18.782624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda18f88f1e14cf5b249eb019249eab0', 'request_id': 'req-ccc35c42-1c1c-4e35-b120-17b53da58515'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:18.789673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda18f88f1e14cf5b249eb019249eab0', 'request_id': 'req-ccc35c42-1c1c-4e35-b120-17b53da58515'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:18.806918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] The token cache is being invalidate because project cda18f88f1e14cf5b249eb019249eab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:18.807211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:18.807962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ccc35c42-1c1c-4e35-b120-17b53da58515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:18.809549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1092/2206] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:18 2022] DELETE /identity/v3/projects/cda18f88f1e14cf5b249eb019249eab0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:18.814948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:18.815784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:18.816212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:18.839787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:18.841020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:18.914993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1115/2207] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:18.923680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:18.923900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:18.924254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:18.962713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:18.963983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:19.004941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1093/2208] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:19.010245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.045074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b0a1-1bd6-4b47-8b67-5b99191bfa1c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.060840 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.061542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.061824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.062197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.063615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:19.063886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.070881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.098817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1116/2209] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:19.104087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.120919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2aa7d-bf32-40b8-986d-0f8ae1ac1be8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.134386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.135455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.135915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.136506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.137401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.140811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.202153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1094/2210] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:19 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:19.207088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.227685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e5d6-6bbf-423d-8dfe-813192576273 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.422636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.423467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.423759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.424040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.424922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.427838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.479969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1117/2211] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:19 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:19.483863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.502299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863be121-6353-4db4-98ae-83d0794a0876 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.512663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.513811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.514500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.514848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.515680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.517384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.529907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1095/2212] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:19.533630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.557069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8022-5295-4ad5-874d-6bc85c3881e1 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.566015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50257-16a0-4f66-b142-3f26bdad55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.567006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50257-16a0-4f66-b142-3f26bdad55f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.567374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50257-16a0-4f66-b142-3f26bdad55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.567666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50257-16a0-4f66-b142-3f26bdad55f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.568600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd50257-16a0-4f66-b142-3f26bdad55f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.572615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd50257-16a0-4f66-b142-3f26bdad55f0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.592315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1118/2213] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:19.594092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.609833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955442d-8056-40df-872d-72607d2cb852 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.618294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.619411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.619924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.620822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] PATH_INFO: `/v3/projects/d2183b9246bf4ed194bfcc628ac87c62/users/f841688103874798a25e8afcfbf03b46/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.640687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2183b9246bf4ed194bfcc628ac87c62, user_id=f841688103874798a25e8afcfbf03b46, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.643983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.679812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1096/2214] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:19 2022] PUT /identity/v3/projects/d2183b9246bf4ed194bfcc628ac87c62/users/f841688103874798a25e8afcfbf03b46/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:19.691392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.691687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.692064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.742089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] MFA Rules not processed for user `f841688103874798a25e8afcfbf03b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:19.743587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:19.817280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1119/2215] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:19.831429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:19.833680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:19.944847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07f9a1-03d4-4bbd-b414-9a4c3949f605 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:19.949009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdac5d6-a379-4481-9bf8-725547a879e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:19.949663 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac5d6-a379-4481-9bf8-725547a879e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:19.949974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac5d6-a379-4481-9bf8-725547a879e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:19.950249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac5d6-a379-4481-9bf8-725547a879e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:19.965130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdac5d6-a379-4481-9bf8-725547a879e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:19.966647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdac5d6-a379-4481-9bf8-725547a879e5 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:19.977340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1097/2216] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:30.452895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:30.454374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:30.523895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099fada-5d8c-4473-9b63-001695ef8384 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:30.528412 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:30.529281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:30.529560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:30.529883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] PATH_INFO: `/v3/users/fd45e5781fdb4507b4d16c467edda71a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:30.531083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd45e5781fdb4507b4d16c467edda71a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:30.533019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:30.583777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd45e5781fdb4507b4d16c467edda71a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:30.584691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd45e5781fdb4507b4d16c467edda71a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:30.597025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd45e5781fdb4507b4d16c467edda71a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:30.604796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd45e5781fdb4507b4d16c467edda71a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:30.605518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd45e5781fdb4507b4d16c467edda71a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:30.619109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1120/2217] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:30 2022] DELETE /identity/v3/users/fd45e5781fdb4507b4d16c467edda71a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:30.624475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:30.624958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:30.625048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:30.643715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:30.644965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:30.708462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1098/2218] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:30.721981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:30.723740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:30.784281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d470c-ce06-4d8e-9060-09242c0e3928 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:30.788107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bc76b-d02d-4384-a2c6-33c8d16d5643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:30.788752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bc76b-d02d-4384-a2c6-33c8d16d5643 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:30.789131 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bc76b-d02d-4384-a2c6-33c8d16d5643 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:30.789377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bc76b-d02d-4384-a2c6-33c8d16d5643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:30.804521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bc76b-d02d-4384-a2c6-33c8d16d5643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:30.806295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bc76b-d02d-4384-a2c6-33c8d16d5643 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:30.818242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1121/2219] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:31.092895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.094639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.119892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db284-9c70-47ad-870e-b1d310e5e6ce None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.125110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.126023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.126311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.126584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] PATH_INFO: `/v3/projects/643c6e09b59c40e0901a28036bd39c14` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.128047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=643c6e09b59c40e0901a28036bd39c14)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.130264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.176197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643c6e09b59c40e0901a28036bd39c14', 'request_id': 'req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.182426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643c6e09b59c40e0901a28036bd39c14', 'request_id': 'req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.188041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643c6e09b59c40e0901a28036bd39c14', 'request_id': 'req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.199912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] The token cache is being invalidate because project 643c6e09b59c40e0901a28036bd39c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:31.200200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.200817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-efd9e6a5-5e15-41a4-ae0a-e37e3badeb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.202363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1099/2220] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:31 2022] DELETE /identity/v3/projects/643c6e09b59c40e0901a28036bd39c14 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:31.207342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.207633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.207913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.225915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:31.227101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.285146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1122/2221] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:31.293633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.293984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.294288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.313588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:31.314816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.323341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1100/2222] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:31.327428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.337076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3effbd-d5fb-4de4-8b75-36cc0926a10f None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.342351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.342998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.343275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.343544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.344259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:31.344559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.346172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.357842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1123/2223] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:31.362177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.372045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5ec65-44da-4b3c-b607-0b480803b013 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.376808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.377456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.377739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.378045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.378748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.380679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.384040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.386823 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.400179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94005-55f7-45e7-8419-d5b63ae17ad9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.406135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.407036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.407321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.407600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] PATH_INFO: `/v3/users/f841688103874798a25e8afcfbf03b46` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.408812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f841688103874798a25e8afcfbf03b46)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.412970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1101/2224] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:31 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:31.413111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.413967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.464134 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f841688103874798a25e8afcfbf03b46'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.465160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f841688103874798a25e8afcfbf03b46'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.476956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f841688103874798a25e8afcfbf03b46'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.480556 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f502196-d61d-49b5-86fd-d44ed5ed7de8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.484138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f841688103874798a25e8afcfbf03b46'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.484822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5cacc83a-24ea-42a2-af2b-81115e02b76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f841688103874798a25e8afcfbf03b46'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:31.485321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.486017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.486307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.486581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.487310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.489234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.500183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1124/2225] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:31 2022] DELETE /identity/v3/users/f841688103874798a25e8afcfbf03b46 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:31.504738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.505025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.505386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.509528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1102/2226] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:31 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:28:31.514742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.516476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.525209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:31.527458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.533222 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf7f41-2d2b-4e7f-8c18-b11471018675 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.586300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1125/2227] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:31.596268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.597613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.599323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.600038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.600325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.600603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.601366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.603052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.613706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1103/2228] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:28:31.617965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.628565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb19d0-752c-453c-8ee1-578b29d4e171 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.633866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.634631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.634954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.635231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.635967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.637619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.648292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1104/2229] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:28:31.652896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.663946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b6360-196e-40fe-9eb2-f44bb50926fa admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.664877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c510ab-43de-4883-9a25-5a9f87c6d336 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.669216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.669559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd5dcd-8551-4635-875f-25a9301b99ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.670126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.670373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd5dcd-8551-4635-875f-25a9301b99ce service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.670468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.670675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] PATH_INFO: `/v3/projects/b5358c7588fe4235a118622c49bc3845/users/7eb11286501848adbec033ee04529bd2/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.670842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd5dcd-8551-4635-875f-25a9301b99ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.671190 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd5dcd-8551-4635-875f-25a9301b99ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.682482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd5dcd-8551-4635-875f-25a9301b99ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.684092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd5dcd-8551-4635-875f-25a9301b99ce service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.687522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5358c7588fe4235a118622c49bc3845, user_id=7eb11286501848adbec033ee04529bd2, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.692061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.697619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1126/2230] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:28:31.706941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1105/2231] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:31 2022] PUT /identity/v3/projects/b5358c7588fe4235a118622c49bc3845/users/7eb11286501848adbec033ee04529bd2/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:31.719293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.719589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.719938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.747355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] MFA Rules not processed for user `7eb11286501848adbec033ee04529bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:31.750827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.818189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1127/2232] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:31.830312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:31.833069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:31.935811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153466a-93d2-45bc-a662-26957a876795 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:31.939848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:31.940554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:31.940794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:31.941077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:31.951430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:31.952913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:31.965578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1106/2233] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:32.006163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:32.007721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:32.079392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:32.080928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:32.094016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ebbf-6a51-48b2-b781-d377a2e335c3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:32.102094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:32.103127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.103606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.103949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] PATH_INFO: `/v3/users/4e6ff229155041b392dd20242a21f21d` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:32.105335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6ff229155041b392dd20242a21f21d)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:32.107466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:32.138766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c36f-9556-407a-b00f-637d1cde2dc8 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:32.145273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:32.147156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.147256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.147539 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] PATH_INFO: `/v3/projects/d2183b9246bf4ed194bfcc628ac87c62` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:32.148779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2183b9246bf4ed194bfcc628ac87c62)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:32.151484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:32.186874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6ff229155041b392dd20242a21f21d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.187589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6ff229155041b392dd20242a21f21d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.202401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6ff229155041b392dd20242a21f21d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.205562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2183b9246bf4ed194bfcc628ac87c62', 'request_id': 'req-992f3bcb-a579-4628-8268-a7e14c483d60'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.210296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6ff229155041b392dd20242a21f21d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.211023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-77f191a5-8742-4852-b4b7-32175ee63573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6ff229155041b392dd20242a21f21d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.211864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2183b9246bf4ed194bfcc628ac87c62', 'request_id': 'req-992f3bcb-a579-4628-8268-a7e14c483d60'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.219074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2183b9246bf4ed194bfcc628ac87c62', 'request_id': 'req-992f3bcb-a579-4628-8268-a7e14c483d60'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.226842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1128/2234] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:32 2022] DELETE /identity/v3/users/4e6ff229155041b392dd20242a21f21d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:32.232720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.233007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.233277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:32.239154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] The token cache is being invalidate because project d2183b9246bf4ed194bfcc628ac87c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:32.239454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.240200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.243152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1107/2235] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:32 2022] DELETE /identity/v3/projects/d2183b9246bf4ed194bfcc628ac87c62 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:28:32.254820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:32.256100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:32.330273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1129/2236] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:32.344284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:32.346180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:32.439106 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f3bcb-a579-4628-8268-a7e14c483d60 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:32.488517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54349-0547-401b-b12f-847045e8c370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:32.489166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54349-0547-401b-b12f-847045e8c370 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.489451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54349-0547-401b-b12f-847045e8c370 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.489726 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54349-0547-401b-b12f-847045e8c370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:32.499624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a54349-0547-401b-b12f-847045e8c370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:32.501041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a54349-0547-401b-b12f-847045e8c370 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:32.511424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1108/2237] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:32.780629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:32.782903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:32.796546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7771e5-3b3c-42a1-8454-b0fb46becaba None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:32.801720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:32.802771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.802956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.803163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] PATH_INFO: `/v3/projects/e33f805afe9e4ad687f9dbca53c6542b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:32.804373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33f805afe9e4ad687f9dbca53c6542b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:32.806305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:32.856788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33f805afe9e4ad687f9dbca53c6542b', 'request_id': 'req-d5de491a-d3f6-4be6-9a81-39fabb3415e5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.863371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33f805afe9e4ad687f9dbca53c6542b', 'request_id': 'req-d5de491a-d3f6-4be6-9a81-39fabb3415e5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.869415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33f805afe9e4ad687f9dbca53c6542b', 'request_id': 'req-d5de491a-d3f6-4be6-9a81-39fabb3415e5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.882139 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] The token cache is being invalidate because project e33f805afe9e4ad687f9dbca53c6542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:32.882437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.883062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d5de491a-d3f6-4be6-9a81-39fabb3415e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:32.884629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1130/2238] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:32 2022] DELETE /identity/v3/projects/e33f805afe9e4ad687f9dbca53c6542b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:32.889970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.890423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.890560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:32.909144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:32.910400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:32.972952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1109/2239] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:32.981839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:32.982420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:32.983057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.003918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:33.005118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:33.013915 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1131/2240] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:33.018070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.028294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9979f1-fb3b-4e99-a37d-498a55747952 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.034719 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.035527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.035814 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.036120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.037247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:33.037617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.039496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.055498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1110/2241] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:33.060091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.069356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09d705-2fca-474b-892c-4b90c6a82396 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.074630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.075278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.075556 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.075828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.076525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.078488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.104979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1132/2242] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:33 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:33.109088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.120372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345a13-1100-4d81-8632-7a4ef8e627e7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.175807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.176478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.176760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.177032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.177728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.179657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.201933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1111/2243] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:33 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:28:33.206116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.216758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb844d-0c29-4de9-88b3-cbf0f427ac5a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.221362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.222047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.222394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.222636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.223408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.224990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.235491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1133/2244] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:33.239598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.250947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739ed26-dd89-4ea5-b823-991511a2d52e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.255548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53aab-6436-4192-9d6d-2922d3f58449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.256204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53aab-6436-4192-9d6d-2922d3f58449 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.256489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53aab-6436-4192-9d6d-2922d3f58449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.256784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53aab-6436-4192-9d6d-2922d3f58449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.257494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53aab-6436-4192-9d6d-2922d3f58449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.259125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53aab-6436-4192-9d6d-2922d3f58449 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.269546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1112/2245] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:33.273626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.284231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05113d3a-ed72-4420-aa19-894a468fe47e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.289331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7151-4bef-4587-bd8f-4cb32bfe1043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.290316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7151-4bef-4587-bd8f-4cb32bfe1043 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.290664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7151-4bef-4587-bd8f-4cb32bfe1043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.290977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7151-4bef-4587-bd8f-4cb32bfe1043 admin admin] PATH_INFO: `/v3/projects/2229a7129f9f437a8f091bc02e7dcab2/users/036abf9b3fad496984e40686f7fb0128/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.307122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7151-4bef-4587-bd8f-4cb32bfe1043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2229a7129f9f437a8f091bc02e7dcab2, user_id=036abf9b3fad496984e40686f7fb0128, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.310207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7151-4bef-4587-bd8f-4cb32bfe1043 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.324171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1134/2246] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:33 2022] PUT /identity/v3/projects/2229a7129f9f437a8f091bc02e7dcab2/users/036abf9b3fad496984e40686f7fb0128/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:33.334245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.334542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.334826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.361129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] MFA Rules not processed for user `036abf9b3fad496984e40686f7fb0128`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:33.362388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:33.416411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.416764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.416981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.428401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1113/2247] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:33.437263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] MFA Rules not processed for user `7eb11286501848adbec033ee04529bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:33.438478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:33.440408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:33.442105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:33.496095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1135/2248] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:28:33.504820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433264b1-8ef3-4aac-90d3-79c125c341eb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:33.508371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5d1b4-2ce5-4310-92bf-8068b1c219d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:33.509007 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d1b4-2ce5-4310-92bf-8068b1c219d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:33.509286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d1b4-2ce5-4310-92bf-8068b1c219d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:33.509557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d1b4-2ce5-4310-92bf-8068b1c219d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:33.518377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5d1b4-2ce5-4310-92bf-8068b1c219d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:33.519797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5d1b4-2ce5-4310-92bf-8068b1c219d0 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:33.528792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1114/2249] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:36.531669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:36.592758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761f0f-07a2-4919-be72-6ba88cbe9cd1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:36.597234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:36.598130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:36.598413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:36.598689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] PATH_INFO: `/v3/users/036abf9b3fad496984e40686f7fb0128` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:36.599856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036abf9b3fad496984e40686f7fb0128)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:36.601766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:36.645978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036abf9b3fad496984e40686f7fb0128'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:36.646632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036abf9b3fad496984e40686f7fb0128'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:36.659036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036abf9b3fad496984e40686f7fb0128'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:36.665548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036abf9b3fad496984e40686f7fb0128'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:36.666825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036abf9b3fad496984e40686f7fb0128'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:36.678569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1136/2250] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:28:36 2022] DELETE /identity/v3/users/036abf9b3fad496984e40686f7fb0128 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:36.683756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:36.684260 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:36.684357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:36.702954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:36.703751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:36.768557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1115/2251] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:36.778756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:36.780157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:36.836976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8362f1-14c1-42b8-bea2-7c165a37f3e5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:36.841537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be010094-baff-4fc3-bdcc-e343823f2084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:36.842221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be010094-baff-4fc3-bdcc-e343823f2084 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:36.842506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be010094-baff-4fc3-bdcc-e343823f2084 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:36.842789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be010094-baff-4fc3-bdcc-e343823f2084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:36.852165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be010094-baff-4fc3-bdcc-e343823f2084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:36.854047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be010094-baff-4fc3-bdcc-e343823f2084 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:36.863961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1137/2252] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:28:37.127483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.128885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:37.141053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e806d3e-ea36-4028-bbac-a31c1420b314 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.146565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.147421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.147689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.147962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] PATH_INFO: `/v3/projects/2229a7129f9f437a8f091bc02e7dcab2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.149122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2229a7129f9f437a8f091bc02e7dcab2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.151070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.198387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2229a7129f9f437a8f091bc02e7dcab2', 'request_id': 'req-25ea61ad-71bb-4611-95f1-f1904d4cf434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:37.204242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2229a7129f9f437a8f091bc02e7dcab2', 'request_id': 'req-25ea61ad-71bb-4611-95f1-f1904d4cf434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:37.210018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2229a7129f9f437a8f091bc02e7dcab2', 'request_id': 'req-25ea61ad-71bb-4611-95f1-f1904d4cf434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:37.223619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] The token cache is being invalidate because project 2229a7129f9f437a8f091bc02e7dcab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:28:37.223918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:37.224529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25ea61ad-71bb-4611-95f1-f1904d4cf434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:28:37.226350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1116/2253] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:28:37 2022] DELETE /identity/v3/projects/2229a7129f9f437a8f091bc02e7dcab2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:37.231929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.232219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.232497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.250902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:37.252082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:37.312293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1138/2254] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:37.319953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.320221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.320510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.339219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:37.340427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:37.348849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1117/2255] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:37.353138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.363705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247a045-bfd3-4ecc-80f6-8da0309c0796 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.368655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.370297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.370701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.371029 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.371707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:28:37.372016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.373616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.385849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1139/2256] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:28:37.390263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.399416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950ff6-11b0-4305-a17b-29bd77f258a1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.404989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.406072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.406850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.407321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.408216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.410230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.437646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1118/2257] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:28:37 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:28:37.442764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.452714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65904-a3e4-4aa9-a0b8-9087809afa2b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.514469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.515147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.515426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.515700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.516389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.518337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.536690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1140/2258] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:28:37 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:28:37.541314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.552239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9d33-8d5d-44d6-90f2-e15de96b4fb4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.557920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.558598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.558864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.559239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.559920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.561564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.572714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1119/2259] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:37.576215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.586020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a82513-82bc-4691-bbce-756dda6ac989 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.590649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d29c-66f2-4dc9-870a-b354fafdf5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.592089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d29c-66f2-4dc9-870a-b354fafdf5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.592374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d29c-66f2-4dc9-870a-b354fafdf5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.592655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d29c-66f2-4dc9-870a-b354fafdf5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.593405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d29c-66f2-4dc9-870a-b354fafdf5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.603035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141d29c-66f2-4dc9-870a-b354fafdf5f3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.614562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1141/2260] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:28:37.619995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.629806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4f75-fe6b-4a75-89a0-b28ce268d83e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.634969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.636014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.636292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.636565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] PATH_INFO: `/v3/projects/23eb0172708e4b3e953985a18b26d530/users/d137853ea57a4364b4dae0ecb964ab2b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.652418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23eb0172708e4b3e953985a18b26d530, user_id=d137853ea57a4364b4dae0ecb964ab2b, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.655130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.667941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1120/2261] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:28:37 2022] PUT /identity/v3/projects/23eb0172708e4b3e953985a18b26d530/users/d137853ea57a4364b4dae0ecb964ab2b/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:28:37.678898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.679187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.679469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.705477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] MFA Rules not processed for user `d137853ea57a4364b4dae0ecb964ab2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:28:37.706771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:37.772470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1142/2262] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:28:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:28:37.783891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:28:37.785569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:28:37.846627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60094d-c884-4649-b2bb-7c6d7bd8689e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:28:37.850203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a56de-6d82-4462-9abe-dbd4cacd5bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:28:37.850844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a56de-6d82-4462-9abe-dbd4cacd5bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:28:37.851126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a56de-6d82-4462-9abe-dbd4cacd5bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:28:37.851402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a56de-6d82-4462-9abe-dbd4cacd5bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:28:37.861053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a56de-6d82-4462-9abe-dbd4cacd5bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:28:37.862534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a56de-6d82-4462-9abe-dbd4cacd5bb8 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:28:37.872700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1121/2263] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:28:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:07.856938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:07.974105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810eced4-fb2a-4296-a433-366fa13afdf2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:07.978639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:07.979651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:07.979936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:07.980210 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] PATH_INFO: `/v3/users/d137853ea57a4364b4dae0ecb964ab2b` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:07.981562 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d137853ea57a4364b4dae0ecb964ab2b)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:07.983585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:08.028906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd137853ea57a4364b4dae0ecb964ab2b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.029554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd137853ea57a4364b4dae0ecb964ab2b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.043505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd137853ea57a4364b4dae0ecb964ab2b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.050791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd137853ea57a4364b4dae0ecb964ab2b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.051656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd137853ea57a4364b4dae0ecb964ab2b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.067277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1143/2264] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:29:07 2022] DELETE /identity/v3/users/d137853ea57a4364b4dae0ecb964ab2b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:08.071776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.072267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.072369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.125321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:08.126851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:08.189954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1122/2265] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:08.196704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:08.198676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:08.304433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fe40-0f77-4947-ad6a-587064b97b59 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:08.309083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f4fe1-0f80-401e-b99d-83881c4d7eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:08.309729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f4fe1-0f80-401e-b99d-83881c4d7eca service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.310044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f4fe1-0f80-401e-b99d-83881c4d7eca service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.310320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f4fe1-0f80-401e-b99d-83881c4d7eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.319249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f4fe1-0f80-401e-b99d-83881c4d7eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:08.320673 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f4fe1-0f80-401e-b99d-83881c4d7eca service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:08.330505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1144/2266] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:08.603588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:08.605717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:08.618590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b2b1-80f9-47e7-a9ce-d3c9fc1942ce None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:08.623859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:08.624733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.625014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.625289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] PATH_INFO: `/v3/projects/23eb0172708e4b3e953985a18b26d530` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.626523 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=23eb0172708e4b3e953985a18b26d530)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:08.628411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:08.675210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23eb0172708e4b3e953985a18b26d530', 'request_id': 'req-9e16de30-72f9-4e31-851c-5d7d268ee7ae'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.681116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23eb0172708e4b3e953985a18b26d530', 'request_id': 'req-9e16de30-72f9-4e31-851c-5d7d268ee7ae'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.687333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23eb0172708e4b3e953985a18b26d530', 'request_id': 'req-9e16de30-72f9-4e31-851c-5d7d268ee7ae'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.702122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] The token cache is being invalidate because project 23eb0172708e4b3e953985a18b26d530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:29:08.702122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.702584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e16de30-72f9-4e31-851c-5d7d268ee7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:08.704196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1123/2267] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:29:08 2022] DELETE /identity/v3/projects/23eb0172708e4b3e953985a18b26d530 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:29:08.709194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.709345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.709600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.763398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:08.764630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:08.837232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1145/2268] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:29:08.845056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.845347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.845628 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.865119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:08.866622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:08.876182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1124/2269] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:08.880161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:08.891890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04923-c5a3-424b-9a07-223df7b62433 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:08.895441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:08.896101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.896384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.896662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.897533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:29:08.897876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:08.899482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:08.911985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1146/2270] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:29:08.916210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:08.926113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac673e-a9ea-499d-9da0-36d27f32fa22 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:08.930760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:08.931400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:08.931681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:08.931953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:08.933207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:08.935104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:08.959203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1125/2271] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:29:08 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:29:08.963487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:08.973290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c620719-a167-4e78-87bd-eaef4b036795 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:09.029961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:09.030632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:09.030918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:09.031197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:09.031884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:09.033822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:09.053124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1147/2272] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:29:08 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:29:09.057975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:09.068096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9d71-2f54-47a1-8f96-292021d246bc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:09.072736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:09.073621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:09.073959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:09.074240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:09.075021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:09.076611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:09.086820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1126/2273] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:29:09.091395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:09.101027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069b5e-1a68-4a11-b61b-8d1d8ed7f92c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:09.106369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6f01f-a35f-4327-a842-e27ea663f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:09.107018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6f01f-a35f-4327-a842-e27ea663f345 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:09.107310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6f01f-a35f-4327-a842-e27ea663f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:09.107584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6f01f-a35f-4327-a842-e27ea663f345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:09.108306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6f01f-a35f-4327-a842-e27ea663f345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:09.109917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6f01f-a35f-4327-a842-e27ea663f345 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:09.119848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1148/2274] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:29:09.123616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:09.133027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd7c1d-d081-40ab-b142-0deef979dbce admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:09.137589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:09.138477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:09.138754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:09.139027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] PATH_INFO: `/v3/projects/0c67771dede545e1ac66c70d16a97571/users/c1bdf0e3d78b484ba3ba0b809a92d508/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:09.158456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c67771dede545e1ac66c70d16a97571, user_id=c1bdf0e3d78b484ba3ba0b809a92d508, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:09.161084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:09.174773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1127/2275] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:29:09 2022] PUT /identity/v3/projects/0c67771dede545e1ac66c70d16a97571/users/c1bdf0e3d78b484ba3ba0b809a92d508/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:09.179729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:09.180060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:09.180341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:09.198373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:09.199592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:09.257417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1149/2276] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:09.267310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:09.269021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:09.325302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3026-dcc5-4284-b054-e4717a5b8a94 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:09.328879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d270-52b2-4dca-bd25-4dcb7b2e8a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:09.329527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d270-52b2-4dca-bd25-4dcb7b2e8a46 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:09.329842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d270-52b2-4dca-bd25-4dcb7b2e8a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:09.330128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d270-52b2-4dca-bd25-4dcb7b2e8a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:09.340097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2d270-52b2-4dca-bd25-4dcb7b2e8a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:09.341531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2d270-52b2-4dca-bd25-4dcb7b2e8a46 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:09.351228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1128/2277] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:14.375933 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:14.377570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:14.392271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c8e34-d8a6-41d9-be59-1a1d22a90f81 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:14.407638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:14.408870 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:14.409364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:14.409861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] PATH_INFO: `/v3/users/a96b5b2e54f24e4da300d722bef91689` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:14.411512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96b5b2e54f24e4da300d722bef91689)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:14.413664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:14.484546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96b5b2e54f24e4da300d722bef91689'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:14.485701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96b5b2e54f24e4da300d722bef91689'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:14.502753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96b5b2e54f24e4da300d722bef91689'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:14.514424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96b5b2e54f24e4da300d722bef91689'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:14.515147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ff430cfb-6951-488e-9103-5585fb3cb78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96b5b2e54f24e4da300d722bef91689'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:14.548025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1150/2278] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:29:14 2022] DELETE /identity/v3/users/a96b5b2e54f24e4da300d722bef91689 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:14.552482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:14.552970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:14.553052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:14.585255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:14.586655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:14.618809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:14.619263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:14.620049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:14.669905 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] MFA Rules not processed for user `c1bdf0e3d78b484ba3ba0b809a92d508`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:14.671151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:14.693283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1129/2279] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:14.700771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:14.702429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:14.756136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1151/2280] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:14.761048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:14.762354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:14.770529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3292e-0c05-427e-8b7b-0103e3262264 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:14.774411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:14.775058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:14.775622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:14.776467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:14.777772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade323ab-23ea-40ee-9991-0f3d66c2b11c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:14.783853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:14.784609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:14.784974 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:14.785290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:14.786081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:14.788163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:14.791567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:14.793368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:14.808152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1130/2281] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:29:14.830560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1152/2282] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:29:14 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:29:14.832258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:14.843967 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d50f47-762a-4982-98d1-9c607a3787a4 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:14.918697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:14.919858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:14.920315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:14.921163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:14.922192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:14.925086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:14.982755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1131/2283] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:29:14 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:29:14.984387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:14.998749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806691cf-27c2-42be-b6d2-fea908252edd admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:15.008154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:15.008951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:15.009301 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:15.009652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:15.011440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:15.013633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:15.038093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1153/2284] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:29:15.043571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:15.056707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4f1e5-12eb-455f-aac8-5e37b94ee6ee admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:15.062495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:15.063385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:15.063671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:15.064338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] PATH_INFO: `/v3/projects/f33ac4a9b1ce406f8c32d20e5f8a5308/users/3e61613c67f14766baa4516d3f395bd8/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:15.090780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33ac4a9b1ce406f8c32d20e5f8a5308, user_id=3e61613c67f14766baa4516d3f395bd8, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:15.093963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:15.117842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1132/2285] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:29:15 2022] PUT /identity/v3/projects/f33ac4a9b1ce406f8c32d20e5f8a5308/users/3e61613c67f14766baa4516d3f395bd8/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:29:15.119169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:15.136219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c36ca-3df5-43d1-948d-47c535ec7368 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:15.279609 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:15.280308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:15.280589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:15.280858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:15.281592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:15.283310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:15.305596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1154/2286] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 18:29:15.311615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:15.348754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376816-fbac-4acd-89d8-9509a5e0de81 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:15.359385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:15.361500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:15.361701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:15.363720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:15.365031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:15.365168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] PATH_INFO: `/v3/projects/f33ac4a9b1ce406f8c32d20e5f8a5308/users/3e61613c67f14766baa4516d3f395bd8/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:15.373166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33ac4a9b1ce406f8c32d20e5f8a5308, user_id=3e61613c67f14766baa4516d3f395bd8, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:15.378804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:15.389755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa7fb1-6c20-489b-9e1f-cd12effcfb6a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:15.401824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1133/2287] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:29:15 2022] PUT /identity/v3/projects/f33ac4a9b1ce406f8c32d20e5f8a5308/users/3e61613c67f14766baa4516d3f395bd8/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:15.504184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:15.505316 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:15.505848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:15.506535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] PATH_INFO: `/v3/projects/ba4f65c4966c4a43bab1e00489a82c6c` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:15.508993 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4f65c4966c4a43bab1e00489a82c6c)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:15.511996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:15.598635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4f65c4966c4a43bab1e00489a82c6c', 'request_id': 'req-8d78c4d2-4571-448a-b9fe-5bf61877942d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:15.614793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4f65c4966c4a43bab1e00489a82c6c', 'request_id': 'req-8d78c4d2-4571-448a-b9fe-5bf61877942d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:15.626149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4f65c4966c4a43bab1e00489a82c6c', 'request_id': 'req-8d78c4d2-4571-448a-b9fe-5bf61877942d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:15.654344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] The token cache is being invalidate because project ba4f65c4966c4a43bab1e00489a82c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:29:15.654696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:15.655486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8d78c4d2-4571-448a-b9fe-5bf61877942d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:15.657406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1155/2288] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:29:15 2022] DELETE /identity/v3/projects/ba4f65c4966c4a43bab1e00489a82c6c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:29:17.001423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:17.006698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:17.024183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656eb27-0427-4bdb-9326-4656de988319 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:17.228371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:17.230247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:17.230745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:17.231177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] PATH_INFO: `/v3/users/90e24f4ffc0842e7ba8eb343b380ca1d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:17.232643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e24f4ffc0842e7ba8eb343b380ca1d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:17.235680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:17.360973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e24f4ffc0842e7ba8eb343b380ca1d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:17.361983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e24f4ffc0842e7ba8eb343b380ca1d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:17.400747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e24f4ffc0842e7ba8eb343b380ca1d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:17.419213 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e24f4ffc0842e7ba8eb343b380ca1d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:17.421771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e24f4ffc0842e7ba8eb343b380ca1d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:17.452116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1134/2289] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:29:16 2022] DELETE /identity/v3/users/90e24f4ffc0842e7ba8eb343b380ca1d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:17.453373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d7cd8-d64e-48ed-b9d2-c697c338d856 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:17.453853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d7cd8-d64e-48ed-b9d2-c697c338d856 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:17.453949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d7cd8-d64e-48ed-b9d2-c697c338d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:17.492070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-007d7cd8-d64e-48ed-b9d2-c697c338d856 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:17.493311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-007d7cd8-d64e-48ed-b9d2-c697c338d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:17.598509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1156/2290] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:17.627557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:17.630234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:17.753770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df7bdd-1599-4659-a7d3-359311e99adf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:17.765839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:17.766674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:17.768442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:17.769522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:17.823258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:17.825293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:17.840787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:17.841079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:17.841367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:17.850514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1135/2291] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:17.897684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:17.902680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:18.028123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1157/2292] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:18.096627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:18.099151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:18.343826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c9015-5548-4abd-b34e-9a10815e7441 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:18.361283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3632efe-907f-45f1-bf03-2c88040a1be3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:18.362273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3632efe-907f-45f1-bf03-2c88040a1be3 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:18.363410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3632efe-907f-45f1-bf03-2c88040a1be3 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:18.364948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3632efe-907f-45f1-bf03-2c88040a1be3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:18.396138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3632efe-907f-45f1-bf03-2c88040a1be3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:18.398340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3632efe-907f-45f1-bf03-2c88040a1be3 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:18.410467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1136/2293] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:29:19.036167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:19.041919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:19.086999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa462f-75c0-45da-9aa2-8b002cc66883 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:19.110600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:19.112116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:19.112323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:19.112626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] PATH_INFO: `/v3/projects/8f9b9eb04f9142a7882ffc5652f97390` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:19.115164 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9b9eb04f9142a7882ffc5652f97390)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:19.126012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:19.218513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9b9eb04f9142a7882ffc5652f97390', 'request_id': 'req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:19.233042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9b9eb04f9142a7882ffc5652f97390', 'request_id': 'req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:19.250708 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9b9eb04f9142a7882ffc5652f97390', 'request_id': 'req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:19.302881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] The token cache is being invalidate because project 8f9b9eb04f9142a7882ffc5652f97390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:29:19.303321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:19.304108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7fc9719f-d50e-4151-bdd5-701a0e5c66f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:19.305835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1158/2294] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:29:19 2022] DELETE /identity/v3/projects/8f9b9eb04f9142a7882ffc5652f97390 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:19.311881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:19.312915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:19.313374 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:19.374856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:19.378438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:19.548612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1137/2295] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:19.557430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:19.558116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:19.558613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:19.598938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:19.601457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:19.640911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1159/2296] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:19.646161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:19.662921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c8b4-18dc-4dfd-a0df-5ce76abd7dc9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:19.686682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:19.687366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:19.687794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:19.688072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:19.688829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:29:19.689288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:19.694511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:19.734760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:19.741605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1138/2297] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:29:19.752769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ba023-8d15-4134-ab20-3dad9545a8fd None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:19.778591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:19.779655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:19.780089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:19.780745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:19.781697 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:19.784593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:19.871205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1160/2298] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:29:19 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:29:19.888431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:19.901138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc32b6c-2c9b-41c9-b3f6-26495a15e669 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:20.052286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:20.053278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.053730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.054512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.069721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:20.080560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:20.130068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1139/2299] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:29:19 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:29:20.133632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:20.150790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b1d1a-893d-458e-8590-bd73fd4a1536 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:20.163961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:20.164630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.165087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.165516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.167206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:20.172353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:20.195892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1161/2300] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:29:20.201652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:20.215169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c703d-1106-4ee0-8c84-5eb7fea0aa7b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:20.238693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653f4d6-d57a-4181-b298-b63b2fc72fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:20.242258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f4d6-d57a-4181-b298-b63b2fc72fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.242708 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f4d6-d57a-4181-b298-b63b2fc72fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.246498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f4d6-d57a-4181-b298-b63b2fc72fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.250164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653f4d6-d57a-4181-b298-b63b2fc72fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:20.256040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653f4d6-d57a-4181-b298-b63b2fc72fb4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:20.298451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1140/2301] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:29:20.300488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:20.319458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ac0f2-1271-42ed-9c28-53c1e8763956 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:20.334479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52180f08-3091-4efb-9faf-9f4dc50f76c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:20.335579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180f08-3091-4efb-9faf-9f4dc50f76c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.347045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180f08-3091-4efb-9faf-9f4dc50f76c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.347382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180f08-3091-4efb-9faf-9f4dc50f76c3 admin admin] PATH_INFO: `/v3/projects/c11c897261a446ba93d853d077916884/users/16cd4e26ab0a495ca177873be7c117b4/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.393624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52180f08-3091-4efb-9faf-9f4dc50f76c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11c897261a446ba93d853d077916884, user_id=16cd4e26ab0a495ca177873be7c117b4, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:20.396737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52180f08-3091-4efb-9faf-9f4dc50f76c3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:20.397613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.398671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.399132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.428866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1162/2302] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:29:20 2022] PUT /identity/v3/projects/c11c897261a446ba93d853d077916884/users/16cd4e26ab0a495ca177873be7c117b4/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:20.439630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68288e-d443-4371-9848-6125f245d644 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.440153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68288e-d443-4371-9848-6125f245d644 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.440613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68288e-d443-4371-9848-6125f245d644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.458542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:20.467215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:20.543319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-fc68288e-d443-4371-9848-6125f245d644 None None] MFA Rules not processed for user `16cd4e26ab0a495ca177873be7c117b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:20.544571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fc68288e-d443-4371-9848-6125f245d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:20.628364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1141/2303] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:29:20.640742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:20.642241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:20.781332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1163/2304] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:20.796809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68288e-d443-4371-9848-6125f245d644 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:20.798410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fc68288e-d443-4371-9848-6125f245d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:20.833332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175f67-5505-4080-a414-f1859bba3fec None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:20.857772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:20.858633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.859029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.859771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:20.887714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:20.891930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:20.923532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1142/2305] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 18:29:20.968663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68288e-d443-4371-9848-6125f245d644 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:20.977264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fbdf9-c84f-45ae-85ff-754e4019826a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:20.978209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbdf9-c84f-45ae-85ff-754e4019826a service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:20.981069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbdf9-c84f-45ae-85ff-754e4019826a service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:20.981357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbdf9-c84f-45ae-85ff-754e4019826a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:21.003922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fbdf9-c84f-45ae-85ff-754e4019826a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:21.016307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fbdf9-c84f-45ae-85ff-754e4019826a service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:21.026819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1164/2306] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:29:21.070110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:21.328747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c6e9c-5267-46b1-8a04-0f28219a1311 service swift] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:21.341675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:21.342927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:21.343124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:21.343389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] PATH_INFO: `/v3/users/16cd4e26ab0a495ca177873be7c117b4` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:21.345202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16cd4e26ab0a495ca177873be7c117b4)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:21.348277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:21.480090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16cd4e26ab0a495ca177873be7c117b4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:21.481047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16cd4e26ab0a495ca177873be7c117b4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:21.513192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16cd4e26ab0a495ca177873be7c117b4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:21.532638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16cd4e26ab0a495ca177873be7c117b4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:21.534212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16cd4e26ab0a495ca177873be7c117b4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:21.563455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1143/2307] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:29:21 2022] DELETE /identity/v3/users/16cd4e26ab0a495ca177873be7c117b4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:21.567736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ad6f-4439-451f-99b3-187008de52cc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:21.568228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ad6f-4439-451f-99b3-187008de52cc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:21.568511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ad6f-4439-451f-99b3-187008de52cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:21.612288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e3a8ad6f-4439-451f-99b3-187008de52cc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:21.616364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e3a8ad6f-4439-451f-99b3-187008de52cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:21.840953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1165/2308] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:21.852661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:21.855527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:21.994401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862712bd-a734-4503-8380-15d1d132c736 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:22.011207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:22.014131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:22.014496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:22.014853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:22.034215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:22.036420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:22.087242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1144/2309] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:29:22.577018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:22.578072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:22.578586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:22.603196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:22.606378 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:22.778244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1166/2310] 10.222.0.84 () {58 vars in 967 bytes} [Fri May 13 18:29:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:22.798883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:22.800338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:22.935542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f651a9-f108-4447-9a56-6421cdc549f5 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:22.949228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb72f-3973-4b7b-86d9-a24cad4f3aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:22.950458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb72f-3973-4b7b-86d9-a24cad4f3aca service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:22.950982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb72f-3973-4b7b-86d9-a24cad4f3aca service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:22.951656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb72f-3973-4b7b-86d9-a24cad4f3aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:22.982019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb72f-3973-4b7b-86d9-a24cad4f3aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:22.988762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb72f-3973-4b7b-86d9-a24cad4f3aca service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:23.015675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1145/2311] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:29:23.039003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:23.041349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:23.092341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f24bc-e407-47ce-9421-b07f1d5cb49c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:23.101330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:23.102520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:23.103032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:23.104124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] PATH_INFO: `/v3/projects/c11c897261a446ba93d853d077916884` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:23.108274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11c897261a446ba93d853d077916884)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:23.113239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:23.198250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11c897261a446ba93d853d077916884', 'request_id': 'req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:23.207231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11c897261a446ba93d853d077916884', 'request_id': 'req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:23.218866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11c897261a446ba93d853d077916884', 'request_id': 'req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:23.246070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] The token cache is being invalidate because project c11c897261a446ba93d853d077916884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:29:23.246413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:23.247198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:23.249745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1167/2312] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:29:23 2022] DELETE /identity/v3/projects/c11c897261a446ba93d853d077916884 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:23.513519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d290-74fc-4e0d-ac81-a711d95cc606 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:23.514040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d290-74fc-4e0d-ac81-a711d95cc606 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:23.514437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d290-74fc-4e0d-ac81-a711d95cc606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:23.544836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-61b7d290-74fc-4e0d-ac81-a711d95cc606 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:23.546325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-61b7d290-74fc-4e0d-ac81-a711d95cc606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:23.630748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1146/2313] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:23.676397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:23.681138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:23.783986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd1e9-6bc5-49d8-8324-1112ae29df62 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:23.794235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05e60-1797-4532-a090-67db66061bae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:23.795069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05e60-1797-4532-a090-67db66061bae service swift] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:23.795647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05e60-1797-4532-a090-67db66061bae service swift] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:23.796134 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05e60-1797-4532-a090-67db66061bae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:23.811742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e05e60-1797-4532-a090-67db66061bae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:23.818199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e05e60-1797-4532-a090-67db66061bae service swift] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:23.836583 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1168/2314] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:29:24.264752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:24.265278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:24.265278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:24.340836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] MFA Rules not processed for user `3e61613c67f14766baa4516d3f395bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:24.342679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:24.468939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:24.469234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:24.469517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:24.500052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:24.501879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:24.511815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1169/2315] 10.222.0.84 () {58 vars in 967 bytes} [Fri May 13 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:24.512421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1147/2316] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:24.525841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:24.539892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77efe03-db12-463c-96c0-feb18a6c40ea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:24.549785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79cf6b-740d-4a86-a62f-6ae7900c3a12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:24.550619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79cf6b-740d-4a86-a62f-6ae7900c3a12 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:24.550971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79cf6b-740d-4a86-a62f-6ae7900c3a12 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:24.551417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79cf6b-740d-4a86-a62f-6ae7900c3a12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:24.563216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79cf6b-740d-4a86-a62f-6ae7900c3a12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:24.565147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79cf6b-740d-4a86-a62f-6ae7900c3a12 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:24.581389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1148/2317] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:29:24.763455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:24.770294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:24.852285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4977-c17e-424c-90b0-0276c9f3e141 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:24.862854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:24.863612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:24.863966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:24.864249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:24.866405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:25.026944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:25.029425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:25.040916 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1170/2318] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:25.226471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc209bd-a236-4d28-a509-7e443487627d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:25.226820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc209bd-a236-4d28-a509-7e443487627d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:25.227096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc209bd-a236-4d28-a509-7e443487627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:25.251412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-edc209bd-a236-4d28-a509-7e443487627d None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:25.252788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-edc209bd-a236-4d28-a509-7e443487627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:25.269322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1149/2319] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:25.295444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:25.312454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385954b6-3920-4b32-834c-86f7e3de3d73 service glance] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:25.341885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9657aa-b2ad-430c-b0fb-eff59b510341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:25.346019 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9657aa-b2ad-430c-b0fb-eff59b510341 service swift] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:25.346709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9657aa-b2ad-430c-b0fb-eff59b510341 service swift] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:25.347151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9657aa-b2ad-430c-b0fb-eff59b510341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:25.375486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9657aa-b2ad-430c-b0fb-eff59b510341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:25.377577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9657aa-b2ad-430c-b0fb-eff59b510341 service swift] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:25.418071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1171/2320] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:29:27.602733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc209bd-a236-4d28-a509-7e443487627d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:27.606207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-edc209bd-a236-4d28-a509-7e443487627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:27.759189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc209bd-a236-4d28-a509-7e443487627d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:27.773039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:27.773952 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:27.774507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:27.775405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] PATH_INFO: `/v3/users/7eb11286501848adbec033ee04529bd2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:27.780725 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb11286501848adbec033ee04529bd2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:27.783257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:27.960630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb11286501848adbec033ee04529bd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:27.961449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb11286501848adbec033ee04529bd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:28.012185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb11286501848adbec033ee04529bd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:28.053102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb11286501848adbec033ee04529bd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:28.066707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb11286501848adbec033ee04529bd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:28.232757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1150/2321] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:29:27 2022] DELETE /identity/v3/users/7eb11286501848adbec033ee04529bd2 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:28.233209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b8cc-b552-487f-88db-774cd578633c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:28.233209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b8cc-b552-487f-88db-774cd578633c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:28.233209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b8cc-b552-487f-88db-774cd578633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:28.265173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a221b8cc-b552-487f-88db-774cd578633c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:28.268285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a221b8cc-b552-487f-88db-774cd578633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:28.551649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1172/2322] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:29:28.562221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:28.574215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:28.743328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b99cd-27a0-4bab-bf16-81348905244d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:28.767248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca443e23-3df3-495b-a08c-025908edd01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:28.767919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443e23-3df3-495b-a08c-025908edd01b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:28.768198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443e23-3df3-495b-a08c-025908edd01b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:28.768488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443e23-3df3-495b-a08c-025908edd01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:28.796903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca443e23-3df3-495b-a08c-025908edd01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:28.798324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca443e23-3df3-495b-a08c-025908edd01b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:28.832322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1151/2323] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:29.415010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221b8cc-b552-487f-88db-774cd578633c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:29.421400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a221b8cc-b552-487f-88db-774cd578633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:29.466525 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221b8cc-b552-487f-88db-774cd578633c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:29.494641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:29.495702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:29.496084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:29.496547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] PATH_INFO: `/v3/projects/b5358c7588fe4235a118622c49bc3845` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:29.500304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5358c7588fe4235a118622c49bc3845)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:29.510797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:29.819291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5358c7588fe4235a118622c49bc3845', 'request_id': 'req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:29.853922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5358c7588fe4235a118622c49bc3845', 'request_id': 'req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:29.873422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5358c7588fe4235a118622c49bc3845', 'request_id': 'req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:29.896275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] The token cache is being invalidate because project b5358c7588fe4235a118622c49bc3845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:29:29.896727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:29.897639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-66b4cf85-9686-472b-9ccf-3fcf0f4d3e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:29:29.899354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1173/2324] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:29:29 2022] DELETE /identity/v3/projects/b5358c7588fe4235a118622c49bc3845 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:29.905432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:29.906077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:29.906077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:29.969893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:29.972511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:30.115236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1152/2325] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:30.117414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.118108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.119171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.162750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:30.168787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:30.179075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1174/2326] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:30.185098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:30.195570 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d595ee1-0be6-4734-93a1-248f0bb8fd77 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:30.209990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:30.212118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.212927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.213647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.214784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:29:30.215099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:30.217488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:30.235148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1153/2327] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:29:30.236296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:30.263408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2648126-4454-434f-94db-71932bf3cd94 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:30.286107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:30.288570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.289007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.289417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.290306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:30.296249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:30.366462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1175/2328] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:29:30 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:29:30.367934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:30.382192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1722-8b3c-42ec-bf0a-0a33fe20e1fc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:30.517451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:30.518272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.518562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.518842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.519543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:30.521467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:30.558209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1154/2329] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:29:30 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:29:30.562509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:30.578605 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9dab5-ec98-40c1-b93a-677ba707f05e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:30.587267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:30.588463 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.588941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.589399 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.591482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:30.595255 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:30.627169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1176/2330] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:29:30.628678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:30.639771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcad94-f379-48b5-b8e3-198961b80c98 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:30.662120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e77593-c527-46cc-906e-0562e09117e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:30.662818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77593-c527-46cc-906e-0562e09117e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.663105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77593-c527-46cc-906e-0562e09117e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.663384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77593-c527-46cc-906e-0562e09117e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.664137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77593-c527-46cc-906e-0562e09117e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:30.666347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77593-c527-46cc-906e-0562e09117e8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:30.697167 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1155/2331] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:29:30.698860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:30.717891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed34e-b39d-4bea-8ea9-125bd3a1a590 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:30.722652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:30.723559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.723839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.724110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] PATH_INFO: `/v3/projects/d2bc35e5e5274a73a951b83dc562cdb1/users/674b1489365e4eaca838327326350448/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.751518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bc35e5e5274a73a951b83dc562cdb1, user_id=674b1489365e4eaca838327326350448, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:30.754367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:30.784639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1177/2332] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:29:30 2022] PUT /identity/v3/projects/d2bc35e5e5274a73a951b83dc562cdb1/users/674b1489365e4eaca838327326350448/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:29:30.786885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856c8c5-8ad6-48bc-99a0-da89d15058c9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:30.787177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856c8c5-8ad6-48bc-99a0-da89d15058c9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:30.787457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856c8c5-8ad6-48bc-99a0-da89d15058c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:30.828293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1856c8c5-8ad6-48bc-99a0-da89d15058c9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:30.829513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1856c8c5-8ad6-48bc-99a0-da89d15058c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:31.022207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1156/2333] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:31.031886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:31.033646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:31.205048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6596-7826-43f2-9887-010fd10a8666 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:31.218341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:31.219021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:31.219303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:31.219587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:31.246229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:31.249276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:31.282474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1178/2334] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:29:32.882083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d496-f218-47df-9d97-367864644f15 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:32.883141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d496-f218-47df-9d97-367864644f15 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:32.883577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d496-f218-47df-9d97-367864644f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:32.925464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9c02d496-f218-47df-9d97-367864644f15 None None] MFA Rules not processed for user `674b1489365e4eaca838327326350448`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:32.927642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9c02d496-f218-47df-9d97-367864644f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:33.069686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1157/2335] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:33.082757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:33.087041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:33.236552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdceb-ccf5-4857-98a4-9d1fcb032696 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:33.246187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9c1c-eb52-4f62-890b-feb13d031e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:33.246976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9c1c-eb52-4f62-890b-feb13d031e50 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:33.247338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9c1c-eb52-4f62-890b-feb13d031e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:33.247691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9c1c-eb52-4f62-890b-feb13d031e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:33.257859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9c1c-eb52-4f62-890b-feb13d031e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:33.260785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9c1c-eb52-4f62-890b-feb13d031e50 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:33.286308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1179/2336] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:34.954449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d3bc-c73b-4f09-b064-f5ba8279f487 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:34.955087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d3bc-c73b-4f09-b064-f5ba8279f487 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:34.955087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d3bc-c73b-4f09-b064-f5ba8279f487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:34.973236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bdf4d3bc-c73b-4f09-b064-f5ba8279f487 None None] MFA Rules not processed for user `674b1489365e4eaca838327326350448`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:34.974508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bdf4d3bc-c73b-4f09-b064-f5ba8279f487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:34.986659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1158/2337] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:38.346938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7100e-8102-4722-ab14-6ed30bd23cea None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:38.347424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7100e-8102-4722-ab14-6ed30bd23cea None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:38.347534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7100e-8102-4722-ab14-6ed30bd23cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:38.364827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7ae7100e-8102-4722-ab14-6ed30bd23cea None None] MFA Rules not processed for user `c1bdf0e3d78b484ba3ba0b809a92d508`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:38.366313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7ae7100e-8102-4722-ab14-6ed30bd23cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:38.424951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1180/2338] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:29:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:40.439217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475044cf-7e7f-49f1-8938-59b0d8f4427d None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.439813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475044cf-7e7f-49f1-8938-59b0d8f4427d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.439813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475044cf-7e7f-49f1-8938-59b0d8f4427d None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.441266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1159/2339] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:29:40.450200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f6aa-e34c-441e-9b5f-8e40c432577d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.450762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f6aa-e34c-441e-9b5f-8e40c432577d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.450762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4f6aa-e34c-441e-9b5f-8e40c432577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.522781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b5d4f6aa-e34c-441e-9b5f-8e40c432577d None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:40.524009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b5d4f6aa-e34c-441e-9b5f-8e40c432577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:40.624186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1181/2340] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:40.632091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475044cf-7e7f-49f1-8938-59b0d8f4427d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:40.634848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-475044cf-7e7f-49f1-8938-59b0d8f4427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:40.713024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca3c7-b608-4a98-92a4-03053004428a None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.713024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca3c7-b608-4a98-92a4-03053004428a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.713024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca3c7-b608-4a98-92a4-03053004428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.724077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475044cf-7e7f-49f1-8938-59b0d8f4427d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:40.729626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:40.731032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.731508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.732458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.743766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-788ca3c7-b608-4a98-92a4-03053004428a None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:40.745202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-788ca3c7-b608-4a98-92a4-03053004428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:40.745736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:40.748264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:40.765334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1160/2341] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:40.855440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1182/2342] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:29:40.860888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:40.862667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:40.868434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fefde-ff60-4abe-b92a-5f51dcc05f11 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.869369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fefde-ff60-4abe-b92a-5f51dcc05f11 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.869932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fefde-ff60-4abe-b92a-5f51dcc05f11 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.872109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1183/2343] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:29:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:29:40.880435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.881049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.881541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.902136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:40.903739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:40.917962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1184/2344] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:29:40.950474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:40.952401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:40.965888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d77cc-fc2d-4015-b86a-ead58382cce5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:40.970375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6a5b4-6fe0-4b39-b4ea-61340d67c792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:40.971248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a5b4-6fe0-4b39-b4ea-61340d67c792 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.971688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a5b4-6fe0-4b39-b4ea-61340d67c792 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.972114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a5b4-6fe0-4b39-b4ea-61340d67c792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:40.981581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6a5b4-6fe0-4b39-b4ea-61340d67c792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:40.982286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e22fe-060b-4099-8136-36a1e6f19c76 service glance] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:40.983419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6a5b4-6fe0-4b39-b4ea-61340d67c792 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:40.990540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0af526-95ec-40e0-8e63-ec0b6a1b4d03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:40.991376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af526-95ec-40e0-8e63-ec0b6a1b4d03 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:40.991664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af526-95ec-40e0-8e63-ec0b6a1b4d03 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:40.991939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af526-95ec-40e0-8e63-ec0b6a1b4d03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:41.001948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0af526-95ec-40e0-8e63-ec0b6a1b4d03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:41.003744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0af526-95ec-40e0-8e63-ec0b6a1b4d03 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:41.004195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1185/2345] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:29:41.013037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1161/2346] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:29:41.185546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b95fc-e051-48d1-a6c2-b028d8da8361 None None] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:41.186158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b95fc-e051-48d1-a6c2-b028d8da8361 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:41.186884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b95fc-e051-48d1-a6c2-b028d8da8361 None None] PATH_INFO: `/` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:41.190348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1186/2347] 10.222.0.84 () {54 vars in 921 bytes} [Fri May 13 18:29:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:29:41.202868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327645d7-ff9d-4bbe-a24c-572de5e18d6d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:41.203062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327645d7-ff9d-4bbe-a24c-572de5e18d6d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:41.203373 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327645d7-ff9d-4bbe-a24c-572de5e18d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:41.252469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-327645d7-ff9d-4bbe-a24c-572de5e18d6d None None] MFA Rules not processed for user `b5e358b1f53b408f8f1e9661ac754c39`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:41.253699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-327645d7-ff9d-4bbe-a24c-572de5e18d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:41.292506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1162/2348] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 18:29:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:29:41.330401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b95fc-e051-48d1-a6c2-b028d8da8361 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:41.378871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b95fc-e051-48d1-a6c2-b028d8da8361 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:41.406727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:41.410163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:41.410443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:41.410787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:41.450397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:41.452619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:41.478460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1187/2349] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:29:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:29:55.652385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:55.652930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:55.653023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:55.721303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:29:55.723009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:29:55.744462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1163/2350] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 18:29:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:29:55.763631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:29:55.793231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c23b00-2f8a-4c4b-94e6-157d3c8a7595 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:29:55.805130 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ed26a-5d71-4f93-a5a5-c502c00dc96f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:29:55.806764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ed26a-5d71-4f93-a5a5-c502c00dc96f service swift] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:29:55.807121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ed26a-5d71-4f93-a5a5-c502c00dc96f service swift] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:29:55.807466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ed26a-5d71-4f93-a5a5-c502c00dc96f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:29:55.817832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ed26a-5d71-4f93-a5a5-c502c00dc96f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:29:55.819492 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ed26a-5d71-4f93-a5a5-c502c00dc96f service swift] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:29:55.829068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1188/2351] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:30:06.690860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:30:06.694482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:30:06.831464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e395-c155-4770-81f3-61dd5bc3a814 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:30:06.840855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:30:06.841674 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:30:06.842125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:30:06.842402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:30:06.845696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:30:06.863071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:30:06.864781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:30:06.878624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1164/2352] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:30:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:30:20.303972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:30:20.304512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:30:20.304512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:30:20.322947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:30:20.324894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:30:20.331936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1189/2353] 10.222.0.84 () {58 vars in 967 bytes} [Fri May 13 18:30:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:30:20.355660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:30:20.367645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bf10-d01f-43dc-ab9c-b1e7309a4e90 service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:30:20.373073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34596681-9190-4b40-895a-d62b6123420b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:30:20.373709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34596681-9190-4b40-895a-d62b6123420b service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:30:20.374028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34596681-9190-4b40-895a-d62b6123420b service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:30:20.374309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34596681-9190-4b40-895a-d62b6123420b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:30:20.382310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34596681-9190-4b40-895a-d62b6123420b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:30:20.383881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34596681-9190-4b40-895a-d62b6123420b service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:30:20.391960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1165/2354] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:30:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:30:22.583253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:30:22.592997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d922f81-611f-433a-a016-eb2de42882e3 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:30:22.596502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:30:22.597135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:30:22.597411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:30:22.597681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:30:22.599631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:30:22.662006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:30:22.663535 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c233135-ab80-4b8e-9757-1b55aa2d35fe service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:30:22.673361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1190/2355] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:30:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:30:51.336696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:30:51.337218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:30:51.337327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:30:51.354820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] MFA Rules not processed for user `f884ba846aa74480b8a7c157a527a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:30:51.356749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:30:51.409771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1166/2356] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:30:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:31:08.007741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:31:08.008295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:31:08.008295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:31:08.026283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] MFA Rules not processed for user `674b1489365e4eaca838327326350448`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:31:08.028172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:31:08.035403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1191/2357] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:31:51.170710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:31:51.180419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30975a9-a3f0-49f8-8304-c4c523e0b25a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:31:51.183933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:31:51.184558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:31:51.184837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:31:51.185110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:31:51.187496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:31:51.200784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:31:51.202244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:31:51.212876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1167/2358] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:31:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:31:55.231795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:31:55.241709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4117a-cdc8-460c-9cba-357e276880af None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:31:55.245132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:31:55.245756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:31:55.246067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:31:55.246337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:31:55.248063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:31:55.261477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:31:55.262852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:31:55.273293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1192/2359] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:31:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:31:58.892597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:31:58.894041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:31:58.908910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe000d-42c9-4e22-88a0-b1882067d176 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:31:58.914358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:31:58.914996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:31:58.915283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:31:58.915562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:31:58.917284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:31:58.976577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:31:58.978300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:31:58.987773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1168/2360] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:31:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:00.913391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:00.924533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6dec3-18f0-4d5f-b184-a81b3fd724fa service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:00.929877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:00.930507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:00.930788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:00.931063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:00.932798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:00.988341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:00.990153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:00.998858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1193/2361] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:16.823070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:16.832818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440cfc-e93e-452b-b104-072ed221e7f6 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:16.836353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:16.836980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:16.837265 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:16.837540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:16.839312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:16.849033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:16.850469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c3c17-cf36-4e69-a0b5-160e61a26c89 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:16.858159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1169/2362] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:18.651939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:18.654196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:18.673111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f9ee7-f629-4477-b777-516cd8573009 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:18.681223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:18.682829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:18.683413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:18.684049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:18.688267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:18.705236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:18.707483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:18.735095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1194/2363] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:22.678655 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826184-df23-4987-9b8f-8953c6f2f2e4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:22.679182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826184-df23-4987-9b8f-8953c6f2f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:22.679281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826184-df23-4987-9b8f-8953c6f2f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:22.698039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e0826184-df23-4987-9b8f-8953c6f2f2e4 None None] MFA Rules not processed for user `57d481d6b7d641838ca9128d2a366702`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:32:22.699231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e0826184-df23-4987-9b8f-8953c6f2f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:22.706329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1170/2364] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:32:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:32:23.007750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:23.018238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412f7b-24a1-4737-958e-b3e7939ba243 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:23.021775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:23.022439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:23.023017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:23.023187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:23.024936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:23.035244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:23.036658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818efad2-0ad9-4144-8260-a20b97de80e6 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:23.044290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1195/2365] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:23.571282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc970-d428-42f5-9b2d-7b5c30669be9 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:23.571665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc970-d428-42f5-9b2d-7b5c30669be9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:23.572022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc970-d428-42f5-9b2d-7b5c30669be9 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:23.573512 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1171/2366] 10.222.0.84 () {54 vars in 960 bytes} [Fri May 13 18:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 18:32:23.579694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:23.579984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:23.580440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:23.616904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:32:23.618136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:23.627537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1196/2367] 10.222.0.84 () {58 vars in 1057 bytes} [Fri May 13 18:32:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:32:23.635219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc970-d428-42f5-9b2d-7b5c30669be9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:23.649345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc970-d428-42f5-9b2d-7b5c30669be9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:23.654505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:23.655419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:23.655809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:23.656103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:23.657951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:23.671572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:23.673142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:23.682923 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1172/2368] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:32.476616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:32.491649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31de34c-7e09-4595-a209-741c8af0683d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:32.497325 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:32.497998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:32.498295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:32.498596 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:32.500762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:32.512966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:32.515071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:32.525057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1197/2369] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:32:36.335627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:32:36.347506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3224ff-bc6b-47dc-909d-46c6583e648e service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:32:36.352775 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:32:36.353409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:32:36.353691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:32:36.353994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:32:36.355740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:32:36.368121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:32:36.369693 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:32:36.380899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1173/2370] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:32:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:33:11.176981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:33:11.186154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5321e9-ad32-4093-91db-3964dc7abecf service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:33:11.189689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:33:11.190353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:33:11.190650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:33:11.190917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:33:11.192661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:33:11.203849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:33:11.205273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:33:11.214448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1198/2371] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:33:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:34:25.708089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:34:25.720495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b0719-8ca0-4280-ac3b-665aca4345f0 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:34:25.726076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:34:25.726709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:34:25.726993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:34:25.727272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:34:25.729019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:34:25.739804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:34:25.741365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:34:25.750521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1174/2372] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:34:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:34:33.396721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:34:33.398167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:34:33.409551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb1e84-ad43-4e64-b95e-6c4bfd562994 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:34:33.413137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:34:33.413769 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:34:33.414084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:34:33.414361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:34:33.422531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:34:33.423952 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:34:33.432709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1199/2373] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:34:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:36:03.646295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:36:03.658020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadda24-ee0c-468a-99d4-9cf936fb3a6b service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:36:03.662968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:36:03.663597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:36:03.663883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:36:03.664162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:36:03.672732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:36:03.674398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:36:03.684127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1175/2374] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:36:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:36:58.121904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:36:58.134128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f8c2-f7b6-489c-8810-26c427887ed0 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:36:58.140191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:36:58.140827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:36:58.141110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:36:58.141387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:36:58.149035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:36:58.150632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:36:58.176477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1200/2375] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:36:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:37:00.553998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:37:00.563759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b90dc-8981-4943-8876-4f923846c1bf service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:37:00.567347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:37:00.567963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:37:00.568241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:37:00.568513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:37:00.576821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:37:00.578286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:37:00.603813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1176/2376] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:37:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:37:26.873059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:37:26.881992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d818-f33b-488f-be6f-57b823448b9e service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:37:26.885503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:37:26.886188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:37:26.886466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:37:26.886739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:37:26.897253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:37:26.898711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:37:26.910221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1201/2377] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:37:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:38:02.345248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:38:02.354227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c8616-0ea8-4a9e-a75f-1e9797dfb360 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:38:02.357873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:38:02.358503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:38:02.358784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:38:02.359060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:38:02.365978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:38:02.367799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:38:02.375471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1177/2378] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:38:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:38:10.872418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:38:10.881470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03fce6-cefe-470a-9866-4547338ff28d service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:38:10.885212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:38:10.885886 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:38:10.886168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:38:10.886440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:38:10.894624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:38:10.896020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:38:10.904872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1202/2379] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:38:16.394383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:38:16.402859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d0b2-338d-4b0b-9238-6cfdcde1df05 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:38:16.407711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:38:16.408441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:38:16.408728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:38:16.409009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:38:16.419206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:38:16.421334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:38:16.431870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1178/2380] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:38:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:39:14.716773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:39:14.765010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f68d3-5da7-4a1b-888c-3526ef8f7ed6 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:39:14.770762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:39:14.771527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:39:14.771918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:39:14.772304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:39:14.783446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:39:14.785194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:39:14.796517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1203/2381] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:39:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:39:25.424780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:39:25.444204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2218c7-8207-40d8-b1a1-b5ba03667fb4 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:39:25.447727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:39:25.448354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:39:25.448633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:39:25.448904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:39:25.457754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:39:25.459239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:39:25.485412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1179/2382] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:39:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:39:33.190602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:39:33.199792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ca54e-4a3c-416b-8109-160b1bca16b2 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:39:33.204132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:39:33.204766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:39:33.205075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:39:33.205351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:39:33.207218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:39:33.292056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:39:33.293482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:39:33.310681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1204/2383] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:39:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:41:11.636227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:41:11.637755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:41:11.732432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28271fcd-6bf5-4eda-892e-165966876a94 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:41:11.738086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:41:11.738834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:41:11.739117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:41:11.739389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:41:11.741264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:41:11.752485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:41:11.754080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:41:11.763538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1180/2384] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:41:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:41:58.214026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:41:58.215658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:41:58.291058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e66a7-54ca-4166-a777-e64ea8092386 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:41:58.294733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:41:58.295373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:41:58.295653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:41:58.295925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:41:58.304383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:41:58.305858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:41:58.315319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1205/2385] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:41:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:42:01.514567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:42:01.524221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1b932-516a-447f-afad-cec015399acb service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:42:01.527724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:42:01.528346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:42:01.528627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:42:01.528903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:42:01.530777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:42:01.598013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:42:01.599428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:42:01.608119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1181/2386] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:42:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:42:28.068268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:42:28.069910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:42:28.145372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17383e-4c04-4960-8aaa-4b0bc9ede909 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:42:28.148931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:42:28.149559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:42:28.149868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:42:28.150143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:42:28.151969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:42:28.234996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:42:28.236499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:42:28.256223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1206/2387] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:42:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:43:03.308818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:43:03.318427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6b0c-58d4-4994-a8c2-5bf6b8a07670 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:43:03.322048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:43:03.322713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:43:03.323000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:43:03.323277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:43:03.325206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:43:03.336049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:43:03.337541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:43:03.346444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1182/2388] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:43:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:43:11.492227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:43:11.493812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:43:11.507555 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bff43e-07d9-40c5-a933-5b9cd6b80d5d service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:43:11.512969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:43:11.513601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:43:11.513929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:43:11.514209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:43:11.516643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:43:11.592053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:43:11.593559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:43:11.611711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1207/2389] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:43:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:43:16.311476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:43:16.313090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:43:16.323162 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3d520-78e1-4f84-b7dd-17caca0bac47 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:43:16.326801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:43:16.327427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:43:16.327711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:43:16.328532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:43:16.330389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:43:16.343218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:43:16.345201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:43:16.355830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1183/2390] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:43:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:44:18.533157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:44:18.544367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2485ea-638c-4f8f-8a1a-319c599a90b5 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:44:18.550595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:44:18.551234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:44:18.551514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:44:18.551789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:44:18.553630 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:44:18.566732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:44:18.568331 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:44:18.579058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1208/2391] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:44:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:44:34.316782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:44:34.318341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:44:34.332138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496d68-ae22-462b-b656-c86b540141c8 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:44:34.337495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:44:34.338142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:44:34.338422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:44:34.338691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:44:34.346304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:44:34.347851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:44:34.356406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1184/2392] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:44:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:45:23.570074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:45:23.579233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ced37-c5b9-4518-add9-8d3f3abc30db service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:45:23.583467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:45:23.584131 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:45:23.584449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:45:23.584724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:45:23.586808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:45:23.659879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:45:23.661308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:45:23.669904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1209/2393] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:45:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:46:17.606811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:46:17.618263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1ead-8a9e-482f-bff0-1faeedaa7f40 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:46:17.623483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:46:17.624104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:46:17.624385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:46:17.624659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:46:17.632844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:46:17.634444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:46:17.643925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1185/2394] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:46:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:46:58.674032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:46:58.686471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c1c50-1823-4843-b5b1-d358a43a5b6a service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:46:58.691783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:46:58.692438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:46:58.692713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:46:58.693675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:46:58.695715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:46:58.772982 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:46:58.774559 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:46:58.792953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1210/2395] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:46:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:47:23.911830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:47:23.921141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99f587-be55-42a6-96db-35b51d279d18 service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:47:23.924848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:47:23.925550 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:47:23.925928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:47:23.926273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:47:23.935822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:47:23.937321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:47:23.964711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1186/2396] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:47:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:47:28.196965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:47:28.206140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b3f74-5cea-4c1d-8122-e06d6281fa13 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:47:28.209912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:47:28.210545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:47:28.210826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:47:28.211101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:47:28.221007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:47:28.222581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:47:28.233552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1211/2397] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:47:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:48:06.357645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:48:06.367626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150743ab-941f-4044-a8c2-6bbe3e53f21f service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:48:06.371230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:48:06.371862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:48:06.372146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:48:06.372426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:48:06.380180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:48:06.381596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:48:06.389430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1187/2398] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:48:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:48:16.219315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:48:16.228250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e35c-a901-412c-9fa4-5acee29fea62 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:48:16.231818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e477d7-c048-4222-9695-58e8eb181c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:48:16.232466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e477d7-c048-4222-9695-58e8eb181c3d service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:48:16.232748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e477d7-c048-4222-9695-58e8eb181c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:48:16.233017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e477d7-c048-4222-9695-58e8eb181c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:48:16.243521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e477d7-c048-4222-9695-58e8eb181c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:48:16.244932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e477d7-c048-4222-9695-58e8eb181c3d service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:48:16.255718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1212/2399] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:48:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:48:18.402838 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:48:18.404400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:48:18.416385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4159-a2b6-409d-99bd-a398b9e3bfae service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:48:18.419922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:48:18.420551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:48:18.420832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:48:18.421109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:48:18.429750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:48:18.431179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:48:18.439768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1188/2400] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:48:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:49:24.592660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:49:24.593208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:49:24.593208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:49:24.619405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] MFA Rules not processed for user `146368a389f94e2fbe6776bb27d60378`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:49:24.620591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:49:24.641825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1213/2401] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:49:24.935494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:49:24.945018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a55d1-c2f5-495b-a40d-21d0ffde4cc9 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:49:24.948572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:49:24.949197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:49:24.949477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:49:24.949749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:49:24.951826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:49:24.961593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:49:24.963114 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:49:24.970994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1189/2402] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:49:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:49:25.290369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:49:25.310996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05527bf0-a206-469e-97c8-458b80b8d900 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:49:25.316401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:49:25.317394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:49:25.318469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:49:25.319342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:49:25.321293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:49:25.334497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:49:25.336128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:49:25.346114 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1214/2403] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:49:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:49:28.102971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:49:28.152053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01037630-2cf3-45b4-beb9-4099ae0f9fbd service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:49:28.164823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:49:28.165622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:49:28.166126 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:49:28.166473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:49:28.176742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:49:28.178902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:49:28.191334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1190/2404] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:49:33.252896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:49:33.276557 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a354ff-d194-4e32-b9ea-681176f8f454 service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:49:33.282504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:49:33.283156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:49:33.283436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:49:33.283709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:49:33.285930 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:49:33.311634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:49:33.313319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:49:33.325265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1215/2405] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:49:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:49:34.068630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:49:34.079761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f18329-6d67-45dd-87a5-26c6b7af165d service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:49:34.085757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:49:34.086405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:49:34.086687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:49:34.086963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:49:34.088791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:49:34.163926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:49:34.165518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590c3c-08e5-4822-a361-b4eb78a88f39 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:49:34.182799 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1191/2406] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:49:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:50:24.599264 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:50:24.611459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30e7b-6032-4866-bbab-e6f33bb3eae5 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:50:24.617736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:50:24.618188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:50:24.618474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:50:24.618749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:50:24.627819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:50:24.629377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:50:24.656783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1216/2407] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:50:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:51:24.279411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138543-1ca8-459f-9196-2409293f3803 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:24.279885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138543-1ca8-459f-9196-2409293f3803 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:24.280017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138543-1ca8-459f-9196-2409293f3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:24.338448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-72138543-1ca8-459f-9196-2409293f3803 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:24.339653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-72138543-1ca8-459f-9196-2409293f3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:24.411228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1192/2408] 10.222.0.84 () {58 vars in 967 bytes} [Fri May 13 18:51:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:51:24.462600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:24.464857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:24.563145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb005-9b78-4c34-928c-c2c099eb37b7 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:24.569879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:24.571033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:24.571402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:24.571833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:24.582451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:24.584094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:24.594330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1217/2409] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 18:51:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 18:51:25.171151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138543-1ca8-459f-9196-2409293f3803 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:25.181444 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138543-1ca8-459f-9196-2409293f3803 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:25.185113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:25.185755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:25.186074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:25.186349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:25.188158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:25.268101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:25.270104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5f887-1c9f-40c4-af6d-02964ce50979 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:25.288621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1193/2410] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:51:26.631278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:26.633067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:26.726062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c3a68-b5a3-431c-97d3-b742ad90e901 service swift] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:26.731188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:26.731843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:26.732125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:26.732403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:26.734330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:26.747087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:26.748875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117f40-eae6-408c-9a7b-2fac1f496be1 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:26.758973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1218/2411] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:51:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:51:27.927884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:27.928397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:27.928518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:27.994759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:27.996025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:28.007844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1194/2412] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:51:28.015811 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.016323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.016941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.036824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:28.038073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:28.049887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1219/2413] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:51:28.050749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.061757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833041f-a4a9-489f-8e9c-9e438b4fc0d6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.069867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.070409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.070696 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.070975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.071717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:51:28.072053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.073783 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.086990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1195/2414] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 18:51:28.091194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.102573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60854aa-3389-48ed-bdd5-46afba367a44 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.107243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.107897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.108178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.108449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.109144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.111054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.147119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1220/2415] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:51:28 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:51:28.151678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.162157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13285f8-67db-426f-aac1-93e1371e54db admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.214272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.214921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.215200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.215474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.216156 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.218070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.237055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1196/2416] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:51:28 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:51:28.241835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.252088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8027dc-d2cc-4641-b5f6-c772a1c11f10 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.257003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.257660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.257981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.258260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.258987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.260580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.270966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1221/2417] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:51:28.274830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.285165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32921c-435a-450f-81b6-843538206dfa admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.289690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada3f24-e82c-4773-b4bd-8af0b4bacc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.290367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3f24-e82c-4773-b4bd-8af0b4bacc45 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.290653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3f24-e82c-4773-b4bd-8af0b4bacc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.290935 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3f24-e82c-4773-b4bd-8af0b4bacc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.291658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada3f24-e82c-4773-b4bd-8af0b4bacc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.293244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada3f24-e82c-4773-b4bd-8af0b4bacc45 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.303093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1197/2418] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:51:28.307046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.317292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b30403-d9d2-4707-b17e-573791f74252 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.321759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.322653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.322935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.323214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] PATH_INFO: `/v3/projects/26dc4b166e3c42ef817a4bcd2cb5fdb0/users/177b61c566a2483190032e0682aa647c/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.338337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dc4b166e3c42ef817a4bcd2cb5fdb0, user_id=177b61c566a2483190032e0682aa647c, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.340963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.354574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1222/2419] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:51:28 2022] PUT /identity/v3/projects/26dc4b166e3c42ef817a4bcd2cb5fdb0/users/177b61c566a2483190032e0682aa647c/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:51:28.359728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e857c-f9fe-4dd6-a754-6f2c465d3bc6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.360090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e857c-f9fe-4dd6-a754-6f2c465d3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.360333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e857c-f9fe-4dd6-a754-6f2c465d3bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.378488 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-279e857c-f9fe-4dd6-a754-6f2c465d3bc6 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:28.379638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-279e857c-f9fe-4dd6-a754-6f2c465d3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:28.438703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1198/2420] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:51:28.448593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:28.507624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d6680-cd96-4ea6-b0df-ddb4d163a0d6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:28.511464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:28.512212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:28.512570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:28.512989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:28.523617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:28.525041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:28.535122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1223/2421] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:51:32.507052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.507540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.507660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.535728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] MFA Rules not processed for user `177b61c566a2483190032e0682aa647c`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:32.536944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:32.599901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1199/2422] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:51:32.604539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:32.614179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29cbda-40cd-4607-8569-44ccd593aa5e service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:32.618686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:32.619344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.619627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.619900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.620792 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:32.622749 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:32.653012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1224/2423] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:51:32 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:51:32.654580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:32.666093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3051d43-0bb4-4e45-bbf5-c612b4ebb753 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:32.731064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:32.731724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.732003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.732276 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.732950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:32.737825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:32.762086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1200/2424] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:51:32 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:51:32.763666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:32.774498 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62acc-b239-491c-a934-d97f2942aa63 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:32.779147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:32.779821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.780102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.780375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.781099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:32.782718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:32.793753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1225/2425] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:51:32.798079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:32.810598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9c00f-03c0-4805-8eb7-a8216f8d97bd admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:32.816031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:32.817105 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.817402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.817682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] PATH_INFO: `/v3/projects/48cb339794a84cd9836214ed2d0ff1d9/users/18976da785ba4ce991c7ec7719752912/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.833324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cb339794a84cd9836214ed2d0ff1d9, user_id=18976da785ba4ce991c7ec7719752912, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:32.836003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:32.849908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1201/2426] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:51:32 2022] PUT /identity/v3/projects/48cb339794a84cd9836214ed2d0ff1d9/users/18976da785ba4ce991c7ec7719752912/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:51:32.853537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:32.864145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8907c-0fd0-4124-8b23-23e0e3b1a85f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:32.921291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b495f-2005-4a5b-be7d-d7798fe4e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:32.922026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b495f-2005-4a5b-be7d-d7798fe4e453 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.922305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b495f-2005-4a5b-be7d-d7798fe4e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.922582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b495f-2005-4a5b-be7d-d7798fe4e453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.923365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b495f-2005-4a5b-be7d-d7798fe4e453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:32.925920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b495f-2005-4a5b-be7d-d7798fe4e453 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:32.936754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1226/2427] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:51:32.940933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:32.951417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739aab1-d432-4e05-a8e1-10a24906bb5e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:32.957084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:32.958009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:32.958295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:32.958601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] PATH_INFO: `/v3/projects/48cb339794a84cd9836214ed2d0ff1d9/users/18976da785ba4ce991c7ec7719752912/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:32.960780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cb339794a84cd9836214ed2d0ff1d9, user_id=18976da785ba4ce991c7ec7719752912, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:32.963497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:32.975193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1202/2428] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:51:32 2022] PUT /identity/v3/projects/48cb339794a84cd9836214ed2d0ff1d9/users/18976da785ba4ce991c7ec7719752912/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 18:51:37.325482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ccf2-dcf5-4459-a86c-47a51789c732 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:37.326006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ccf2-dcf5-4459-a86c-47a51789c732 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:37.326123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ccf2-dcf5-4459-a86c-47a51789c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:37.352670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ea42ccf2-dcf5-4459-a86c-47a51789c732 None None] MFA Rules not processed for user `18976da785ba4ce991c7ec7719752912`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:37.353894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ea42ccf2-dcf5-4459-a86c-47a51789c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:37.426494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1227/2429] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:51:37.441861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:51:37.515658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6aea7-f861-47c2-a074-3c697b3ee32a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:51:37.522008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:51:37.522680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:37.522965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:37.523243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:37.584203 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:51:37.585745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:51:37.595280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1203/2430] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:51:38.636151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:51:38.636665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:51:38.636844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:51:38.656199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] MFA Rules not processed for user `177b61c566a2483190032e0682aa647c`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:51:38.657582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:51:38.666228 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1228/2431] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:52:18.969249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:19.031555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c47f-2535-4f5a-ac7b-6fc0f929a944 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:19.035204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:19.035839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:19.036122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:19.036398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:19.089729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:19.091183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:19.100544 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1204/2432] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:52:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:52:19.262634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:19.318162 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e3ac-22fa-41af-b1b1-081cd693e50d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:19.321921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:19.322600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:19.322881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:19.323156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:19.324948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:52:19.386875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:19.388236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:19.398030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1229/2433] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:52:22.745432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:22.746905 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:52:22.763091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebd02-c1e1-4dc6-95d9-e0ef20cc5b94 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:22.768370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:22.769324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:22.769607 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:22.770059 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] PATH_INFO: `/v3/users/57d481d6b7d641838ca9128d2a366702` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:22.783818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d481d6b7d641838ca9128d2a366702)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:22.786485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:22.829984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d481d6b7d641838ca9128d2a366702'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:22.830621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d481d6b7d641838ca9128d2a366702'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:22.841879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d481d6b7d641838ca9128d2a366702'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:22.849333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d481d6b7d641838ca9128d2a366702'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:22.850039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2c4dd1ed-48cb-42ae-b2e9-574f5203e161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d481d6b7d641838ca9128d2a366702'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:22.868377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1205/2434] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:52:22 2022] DELETE /identity/v3/users/57d481d6b7d641838ca9128d2a366702 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:52:23.046178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.056172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7841f2-5912-4f9a-8695-09bc8124f497 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.117444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.118350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.118628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.118906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] PATH_INFO: `/v3/projects/2ae50c654dcc41c5b071040530bf36ef` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.120083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae50c654dcc41c5b071040530bf36ef)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.122024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.170177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae50c654dcc41c5b071040530bf36ef', 'request_id': 'req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:23.176512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae50c654dcc41c5b071040530bf36ef', 'request_id': 'req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:23.181782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae50c654dcc41c5b071040530bf36ef', 'request_id': 'req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:23.193907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] The token cache is being invalidate because project 2ae50c654dcc41c5b071040530bf36ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:52:23.194192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:23.194828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2e066766-c4bd-4bc9-a35b-a7c47e6bd926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:52:23.196396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1230/2435] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:52:23 2022] DELETE /identity/v3/projects/2ae50c654dcc41c5b071040530bf36ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:52:23.202377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.202740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.203025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.223358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:52:23.224551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:52:23.281829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1206/2436] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:52:23.290884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712810-a430-4284-8869-804107acb6c1 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.291173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712810-a430-4284-8869-804107acb6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.291452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e712810-a430-4284-8869-804107acb6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.310939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7e712810-a430-4284-8869-804107acb6c1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:52:23.312143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7e712810-a430-4284-8869-804107acb6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:52:23.320203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1231/2437] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:52:23.324385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.334975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3b9e-dd03-4df3-a00c-24725228b3a8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.339950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.340618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.340899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.341176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.341950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:52:23.342256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.343888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.356736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1207/2438] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:52:23.360824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712810-a430-4284-8869-804107acb6c1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.371472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e712810-a430-4284-8869-804107acb6c1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.377206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.377988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.378281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.378590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.379369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.381290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.407411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1232/2439] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:52:23.412713 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.422983 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be61cce-26cf-4e3a-9384-225b1049f226 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.480245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.480920 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.481206 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.481485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.482244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.484154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.505969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1208/2440] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/users => generated 278 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:52:23.510016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.521112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac21c-dd83-4c44-aafc-4a0a576d99ce admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.525836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.526523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.526799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.527077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.527808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.529395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.540664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1233/2441] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:52:23.544555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.555018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267a364-4946-48f9-af0d-f68bdaf0c05d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.559611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd56170-861f-4908-8a74-5233b7db99a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.560270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd56170-861f-4908-8a74-5233b7db99a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.560554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd56170-861f-4908-8a74-5233b7db99a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.560829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd56170-861f-4908-8a74-5233b7db99a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.561567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd56170-861f-4908-8a74-5233b7db99a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.563267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd56170-861f-4908-8a74-5233b7db99a5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.573777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1209/2442] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:52:23.577747 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.589210 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4344040-8d13-4d70-bc74-136a28657843 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.593997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.594895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.595201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.595470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] PATH_INFO: `/v3/projects/266ceb671a3e4c50b9292fca8641a075/users/3a89d4e0a0034f46b532b4e9964916e2/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.611461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266ceb671a3e4c50b9292fca8641a075, user_id=3a89d4e0a0034f46b532b4e9964916e2, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.614757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.627083 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1234/2443] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:52:23 2022] PUT /identity/v3/projects/266ceb671a3e4c50b9292fca8641a075/users/3a89d4e0a0034f46b532b4e9964916e2/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:52:23.637507 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a123-6f81-4810-953d-8148339ee44b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.637829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a123-6f81-4810-953d-8148339ee44b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.638101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a123-6f81-4810-953d-8148339ee44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.666782 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6256a123-6f81-4810-953d-8148339ee44b None None] MFA Rules not processed for user `3a89d4e0a0034f46b532b4e9964916e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:52:23.668238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6256a123-6f81-4810-953d-8148339ee44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:52:23.737855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1210/2444] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:52:23.742621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.808100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee8b18-1a27-4433-baa8-e0e709bb28e6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.812713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.813359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.813655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.813962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.814654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.817289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.843586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1235/2445] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:52:23.848915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a123-6f81-4810-953d-8148339ee44b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.859425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a123-6f81-4810-953d-8148339ee44b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.916602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.917256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.917541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.917988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.918687 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.920660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.943562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1211/2446] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:52:23 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 18:52:23.946313 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.958111 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7a34-dd94-428b-abe6-3cc298f9ec6c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.962899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.963570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.963852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.964128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:23.964918 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:23.966569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:23.977384 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1236/2447] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:52:23.981576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:23.991842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6068b4-b832-4702-b14b-b3fc047a26e0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:23.996411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:23.997272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:23.997551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:23.997851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] PATH_INFO: `/v3/projects/6e37dba476454ccb9707137898556afd/users/4e40884d9fb840399ae32d5646d8e072/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:24.013844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e37dba476454ccb9707137898556afd, user_id=4e40884d9fb840399ae32d5646d8e072, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:24.016469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:24.029347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1212/2448] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:52:23 2022] PUT /identity/v3/projects/6e37dba476454ccb9707137898556afd/users/4e40884d9fb840399ae32d5646d8e072/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:52:24.033321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:24.043998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be884-02f3-423b-a42b-e33f74659332 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:24.106209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18742821-f911-401c-918f-f85160c666c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:24.106911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18742821-f911-401c-918f-f85160c666c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:24.107069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18742821-f911-401c-918f-f85160c666c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:24.107349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18742821-f911-401c-918f-f85160c666c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:24.108084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18742821-f911-401c-918f-f85160c666c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:24.109688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18742821-f911-401c-918f-f85160c666c7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:24.120959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1237/2449] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:52:24.125437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:52:24.135595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56957b3a-b1fd-48a5-84a0-9ec79dfd17c1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:52:24.140455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:52:24.141431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:24.141613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:24.141927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] PATH_INFO: `/v3/projects/6e37dba476454ccb9707137898556afd/users/4e40884d9fb840399ae32d5646d8e072/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:24.143959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e37dba476454ccb9707137898556afd, user_id=4e40884d9fb840399ae32d5646d8e072, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:52:24.147196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:52:24.158398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1213/2450] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:52:24 2022] PUT /identity/v3/projects/6e37dba476454ccb9707137898556afd/users/4e40884d9fb840399ae32d5646d8e072/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:52:24.169003 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:52:24.169298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:52:24.169582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:52:24.197736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] MFA Rules not processed for user `4e40884d9fb840399ae32d5646d8e072`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:52:24.199107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:52:24.267405 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1238/2451] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:52:24 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:53:11.332807 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:53:11.334772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:53:11.409761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa34c8b-73fd-4e34-9b42-2ce272f5e05d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:53:11.413448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:53:11.414121 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:53:11.414405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:53:11.414680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:53:11.416426 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:53:11.425416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:53:11.427363 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:53:11.434999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1214/2452] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:53:25.004979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:53:25.007355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:53:25.078151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeb352-3c63-4a99-aa74-74ceff3be476 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:53:25.081849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:53:25.082497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:53:25.082778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:53:25.083052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:53:25.085182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:53:25.166128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:53:25.167566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:53:25.184941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1239/2453] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:53:25.328898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:53:25.338468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22380-adfe-421f-82ce-28a3a6896a2e service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:53:25.341985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:53:25.342611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:53:25.342890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:53:25.343159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:53:25.352230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:53:25.353639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:53:25.362779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1215/2454] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:53:25.616878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:53:25.625638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686d236-fd40-43a7-a5a7-0b0fbd58eb33 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:53:25.629219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:53:25.629902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:53:25.630203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:53:25.630480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:53:25.685822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:53:25.687250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:53:25.696736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1240/2455] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:56:20.612934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:56:20.621698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf931-c05a-42d6-a4da-69ea6d0e5106 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:56:20.625580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:56:20.626232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:56:20.626514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:56:20.626787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:56:20.628513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:56:20.685154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:56:20.686619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:56:20.695659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1216/2456] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:56:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:56:21.317094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:56:21.318495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:56:21.329545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5fe1c-9d49-4623-82db-98a2bce3cdb7 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:56:21.333136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:56:21.333766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:56:21.334077 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:56:21.334357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:56:21.336210 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:56:21.404701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:56:21.406182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:56:21.415953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1241/2457] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:56:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:56:31.596837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:56:31.598241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:56:31.664694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0852-7388-4231-a151-c5e07710e9e1 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:56:31.669616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:56:31.670286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:56:31.670568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:56:31.670844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:56:31.672563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:56:31.684122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:56:31.685683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:56:31.695440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1217/2458] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:56:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:17.280201 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:17.289275 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166c1c-4b50-4544-a098-efcecd47efd8 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:17.292826 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:17.293457 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:17.293739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:17.294046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:17.300985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:17.302440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:17.310171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1242/2459] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:21.097528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:21.106487 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6891-c61b-4553-b554-9d2f48ec08b8 service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:21.110002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:21.110624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:21.110901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:21.111172 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:21.112868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:21.169201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:21.170658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:21.180438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1218/2460] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:21.256995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:21.266142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24740-ceab-423a-a9af-57347e5cbd8a service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:21.270798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:21.271439 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:21.271724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:21.272004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:21.273773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:21.352981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:21.354454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:21.372890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1243/2461] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:21.699914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:21.712604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe8005-6f80-41f8-82b6-7a9278dfd3c5 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:21.716256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:21.716884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:21.717194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:21.717466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:21.719645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:21.741045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:21.742501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:21.754805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36863-e2cb-4e72-b2ef-b0bdfa8be05b service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:21.758450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:21.759089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:21.759374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:21.759649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:21.761386 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:21.807595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:21.809025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:21.829593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1219/2462] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:21.834649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:21.837366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:21.849936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1244/2463] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 18:58:23.576340 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:23.577923 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:23.591989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714256d9-7d0e-43af-aaf9-1cebf761ff90 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:23.607721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:23.608802 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:23.609047 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:23.609328 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:23.611225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:23.626970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:23.629840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:23.646801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1220/2464] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:24.487219 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:24.498919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b7be5-a5c7-4980-b21b-a065e8e7fb1c service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:24.506578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:24.507467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:24.508758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:24.509057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:24.518067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:24.520808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:24.531470 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1245/2465] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:27.036060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:27.045112 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55797ef8-a3a4-4d42-966d-cb6b9c2c46dc service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:27.048638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:27.049257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:27.049536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:27.049833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:27.052247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:27.112368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:27.114836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:27.124493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1221/2466] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:30.553570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:30.555121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:30.569199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988f70-625b-47a5-acd5-909dfb0b4650 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:30.573733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:30.574631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:30.574911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:30.575183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] PATH_INFO: `/v3/users/f884ba846aa74480b8a7c157a527a56a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:30.576350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f884ba846aa74480b8a7c157a527a56a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:30.578349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:30.623253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f884ba846aa74480b8a7c157a527a56a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.623898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f884ba846aa74480b8a7c157a527a56a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.635799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f884ba846aa74480b8a7c157a527a56a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.642568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f884ba846aa74480b8a7c157a527a56a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.643229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-26060329-e4a6-42bd-8be7-50a45d63ac59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f884ba846aa74480b8a7c157a527a56a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.655276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1246/2467] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 18:58:30 2022] DELETE /identity/v3/users/f884ba846aa74480b8a7c157a527a56a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:58:30.824339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:30.834159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544e38-4a15-497a-890e-5322cfd2718b service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:30.892355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:30.893138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:30.893420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:30.893698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] PATH_INFO: `/v3/projects/bc5eea7113114071836cb1707903940f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:30.895029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5eea7113114071836cb1707903940f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:30.896927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:30.940758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5eea7113114071836cb1707903940f', 'request_id': 'req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.946711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5eea7113114071836cb1707903940f', 'request_id': 'req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.951934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5eea7113114071836cb1707903940f', 'request_id': 'req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.964323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] The token cache is being invalidate because project bc5eea7113114071836cb1707903940f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 18:58:30.964608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.965217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-302f71f7-2d4f-4dfa-93f7-8eccf87b29e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 18:58:30.966777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1222/2468] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 18:58:30 2022] DELETE /identity/v3/projects/bc5eea7113114071836cb1707903940f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:58:30.973614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:30.973941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:30.974220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:30.992355 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:58:30.993560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:31.052410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1247/2469] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:58:31.060038 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.060331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.060613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.078471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:58:31.079653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:31.088219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1223/2470] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:58:31.092318 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.102482 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0614da-7eaf-4294-984a-ae9f23a4c3a9 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.106932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.107572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.107851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.108126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.108846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 18:58:31.109149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.110784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.122618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1248/2471] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 18:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 18:58:31.126669 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.135661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f208ed-854f-464d-b45a-7bf7fdd779d2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.140304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.140945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.141230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.141510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.142235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.144841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.168432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1224/2472] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 18:58:31 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:58:31.172357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.182831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4a6c1-29dd-4bfd-a0f7-2293c94ba8ea admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.235587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.236239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.236517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.236789 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.237480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.240178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.259929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1249/2473] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 18:58:31 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 18:58:31.263995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.274559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19fe6-2291-4e41-b647-623b521b0bdd admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.279083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.279721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.279999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.280270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.280987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.282613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.293101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1225/2474] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:58:31.296959 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.307476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf34a8-ee20-4ec2-82d5-e7dde8c7ea7c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.311967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d99af-b19e-4932-8761-8cf9d53f75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.312606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d99af-b19e-4932-8761-8cf9d53f75bf admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.312887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d99af-b19e-4932-8761-8cf9d53f75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.313158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d99af-b19e-4932-8761-8cf9d53f75bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.313909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d99af-b19e-4932-8761-8cf9d53f75bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.315469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d99af-b19e-4932-8761-8cf9d53f75bf admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.324865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1250/2475] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 18:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 18:58:31.328734 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.338969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac913-ea54-445f-8f37-6f794bba3666 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.343651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.344535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.344837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.345108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] PATH_INFO: `/v3/projects/77692989da6e4c409bd09d68235495e3/users/5441b55f8fbf4ff392afe0bb3d040d71/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.359566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77692989da6e4c409bd09d68235495e3, user_id=5441b55f8fbf4ff392afe0bb3d040d71, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.362305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.375627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1226/2476] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 18:58:31 2022] PUT /identity/v3/projects/77692989da6e4c409bd09d68235495e3/users/5441b55f8fbf4ff392afe0bb3d040d71/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 18:58:31.380580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f765-1b5c-4f5d-bac7-9802ddfae8ba None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.380872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f765-1b5c-4f5d-bac7-9802ddfae8ba None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.381148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f765-1b5c-4f5d-bac7-9802ddfae8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.398161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8878f765-1b5c-4f5d-bac7-9802ddfae8ba None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:58:31.399271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8878f765-1b5c-4f5d-bac7-9802ddfae8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:31.454221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1251/2477] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:58:31.463851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:31.465517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:31.523021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa3f5d-50fb-4d04-98d0-6830c0e7770b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:31.526661 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:31.527296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:31.527580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:31.527858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:31.537643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:31.539102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:31.548341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1227/2478] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:35.512216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8affab1-95a3-47de-a83f-ead1a512bce3 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:35.512773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8affab1-95a3-47de-a83f-ead1a512bce3 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:35.512773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8affab1-95a3-47de-a83f-ead1a512bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:35.539984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a8affab1-95a3-47de-a83f-ead1a512bce3 None None] MFA Rules not processed for user `5441b55f8fbf4ff392afe0bb3d040d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:58:35.541115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a8affab1-95a3-47de-a83f-ead1a512bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:35.612265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1252/2479] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 18:58:35.627041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:35.629280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:35.703365 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931422-cf4a-4355-8256-e5428eb58b5f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:35.709319 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:35.710017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:35.710302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:35.710579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:35.718743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:35.720339 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:35.729595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1228/2480] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:37.104124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:37.104658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:37.104658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:37.122862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] MFA Rules not processed for user `5441b55f8fbf4ff392afe0bb3d040d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 18:58:37.124048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:37.131570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1253/2481] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 18:58:37.448730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:37.458287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ab0b-9d33-41e6-914b-8935fe11d2dc service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:37.461866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:37.462497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:37.462778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:37.463411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:37.464821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:37.475366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:37.476895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:37.485908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1229/2482] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:39.820354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:39.821753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:39.896362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf335e-93c2-4785-acb6-b6822632283b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:39.912758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:39.913431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:39.913716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:39.914365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:39.919449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:39.934951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:39.936566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:39.948469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1254/2483] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:51.819263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:51.833681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c0b2-bb78-48d0-b1f2-1368754c19be service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:51.839191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:51.839831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:51.840110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:51.840386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:51.842279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:51.854705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:51.856424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:51.867325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1230/2484] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 18:58:54.776103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 18:58:54.788487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a566-2d9d-4049-bde0-b7e0607e16bb service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 18:58:54.793899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 18:58:54.794542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 18:58:54.795436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 18:58:54.795721 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 18:58:54.797486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 18:58:54.809434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 18:58:54.811119 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 18:58:54.822039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1255/2485] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 18:58:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:00:21.590609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:00:21.590609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:00:21.663346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b2ed-b044-473d-8c20-ea001db1f4fc service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:00:21.666938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:00:21.667575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:00:21.667854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:00:21.668127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:00:21.669922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:00:21.721707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:00:21.723339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:00:21.741531 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:00:21.743054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:00:21.752602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1231/2486] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:00:21 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:00:21.754645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05c2a5-3d88-4ee5-8571-bd33d2bd9f1c service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:00:21.758517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:00:21.759148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:00:21.759437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:00:21.759751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:00:21.768349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:00:21.770485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:00:21.779655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1256/2487] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:00:21 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:01:35.558839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:01:35.595116 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b35f6-1dfb-4da7-b2bc-46ed5dd5f445 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:01:35.600231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:01:35.600872 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:01:35.601153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:01:35.601428 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:01:35.603195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:01:35.625845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:01:35.628318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:01:35.637763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1232/2488] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:01:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:17.346137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:17.355025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb522ed6-0dba-4117-80ee-7807604e255c service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:17.359232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:17.359682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:17.360027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:17.360402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:17.362779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:17.482406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:17.483851 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:17.503198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1257/2489] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:17.895999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:17.897421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:17.910645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec562f-5319-4b1e-a399-64d37028f2f5 service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:17.915541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:17.916182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:17.916462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:17.916737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:17.918609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:17.953966 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:17.956070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:17.976000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1233/2490] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:02:20.081529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:20.101335 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583506-01f8-4903-9c28-e2c1e03d0f9e service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:20.106804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:20.107822 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:20.108207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:20.108586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:20.112209 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:20.185720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:20.187320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e8c9b-0529-4b4d-8262-b76da9eaa412 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:20.201148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1258/2491] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:20.349946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:20.351379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:20.364642 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e59525-373e-491a-a5e3-167e19ab31f3 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:20.369371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:20.370770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:20.371249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:20.371699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] PATH_INFO: `/v3/users/3a89d4e0a0034f46b532b4e9964916e2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:20.373055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a89d4e0a0034f46b532b4e9964916e2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:20.375182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:20.424283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a89d4e0a0034f46b532b4e9964916e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:20.425721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a89d4e0a0034f46b532b4e9964916e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:20.438640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a89d4e0a0034f46b532b4e9964916e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:20.446221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a89d4e0a0034f46b532b4e9964916e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:20.447060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a89d4e0a0034f46b532b4e9964916e2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:20.463233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1234/2492] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:20 2022] DELETE /identity/v3/users/3a89d4e0a0034f46b532b4e9964916e2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:20.467472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:20.467772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:20.468058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:20.496495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:20.497729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:20.565431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1259/2493] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:20.572152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:20.573844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:20.635941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648180c-9cb0-4e3e-ad68-823bae6cd764 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:20.643542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:20.644235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:20.644521 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:20.644813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:20.654086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:20.655519 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:20.665409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1235/2494] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:20.960413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:20.961888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:20.981030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4469e-36dc-4bfb-bc26-7473fbe30263 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:20.997000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:20.998885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:20.999218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:20.999807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] PATH_INFO: `/v3/projects/266ceb671a3e4c50b9292fca8641a075` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:21.000711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266ceb671a3e4c50b9292fca8641a075)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:21.003881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:21.070724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266ceb671a3e4c50b9292fca8641a075', 'request_id': 'req-461b83d7-f398-4437-ae27-cb12bf71e283'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.077809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266ceb671a3e4c50b9292fca8641a075', 'request_id': 'req-461b83d7-f398-4437-ae27-cb12bf71e283'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.084718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266ceb671a3e4c50b9292fca8641a075', 'request_id': 'req-461b83d7-f398-4437-ae27-cb12bf71e283'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.110527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] The token cache is being invalidate because project 266ceb671a3e4c50b9292fca8641a075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:21.112478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.113270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.115424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1260/2495] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:20 2022] DELETE /identity/v3/projects/266ceb671a3e4c50b9292fca8641a075 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:21.119108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:21.137694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970653-0ed0-47d7-9bb1-7f4730858589 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:21.214029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:21.214990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:21.215281 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:21.215564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] PATH_INFO: `/v3/users/4e40884d9fb840399ae32d5646d8e072` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:21.216819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e40884d9fb840399ae32d5646d8e072)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:21.219017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:21.302493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e40884d9fb840399ae32d5646d8e072'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.303351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e40884d9fb840399ae32d5646d8e072'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.318012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e40884d9fb840399ae32d5646d8e072'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.325860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e40884d9fb840399ae32d5646d8e072'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.326911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d5778bb7-1191-4db8-9d5e-323c268b60c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e40884d9fb840399ae32d5646d8e072'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:21.347537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1236/2496] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:21 2022] DELETE /identity/v3/users/4e40884d9fb840399ae32d5646d8e072 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:21.934392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:21.938622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:21.953995 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b83d7-f398-4437-ae27-cb12bf71e283 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.018584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.019660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.019950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.020227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] PATH_INFO: `/v3/projects/6e37dba476454ccb9707137898556afd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.021491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e37dba476454ccb9707137898556afd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.023508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.076017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e37dba476454ccb9707137898556afd', 'request_id': 'req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:22.083558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e37dba476454ccb9707137898556afd', 'request_id': 'req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:22.089635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e37dba476454ccb9707137898556afd', 'request_id': 'req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:22.103037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] The token cache is being invalidate because project 6e37dba476454ccb9707137898556afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:22.103403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:22.104397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-d63a405f-24a7-45ab-b66a-a48f93c3aeb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:22.106012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1261/2497] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:21 2022] DELETE /identity/v3/projects/6e37dba476454ccb9707137898556afd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:22.111528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.112264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.112264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.175103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:22.176623 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:22.247569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1237/2498] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:22.256327 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.256607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.256889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.280252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:22.281701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:22.290261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1262/2499] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:22.294370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.306679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06fe27-170c-46fa-a86a-696cbb75d4dd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.311876 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.312668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.312955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.313362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.315538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:02:22.315855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.317467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.336181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1238/2500] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:02:22.337458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.347478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26910e-9485-4352-9f42-b7746d3ed2ae None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.353030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.353691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.354006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.354280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.354971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.356948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.406116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1263/2501] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:02:22.407202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.417438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8fef1-ff25-45ef-903e-bf1a42678a1d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.475099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.475778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.476057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.476337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.477077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.479055 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.499388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1239/2502] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:02:22.504320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.514606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaed261-5485-4a5d-ae5c-ee7a013ceea9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.519448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.520108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.520467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.520753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.521475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.523121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.534914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1264/2503] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:02:22.538574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.549471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8d3f-7eb7-4a60-85e3-a811607736d4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.554681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84830e6f-6c44-43bf-925d-590734cd0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.555894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84830e6f-6c44-43bf-925d-590734cd0b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.555894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84830e6f-6c44-43bf-925d-590734cd0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.556117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84830e6f-6c44-43bf-925d-590734cd0b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.556709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84830e6f-6c44-43bf-925d-590734cd0b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.558366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84830e6f-6c44-43bf-925d-590734cd0b18 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.569415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1240/2504] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 19:02:22.573481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.584267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6666be-bb46-4a9a-bdc2-fcb7e52fd041 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.589512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.590497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.590962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.591262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] PATH_INFO: `/v3/projects/e0f4febfe31a40c0a0812734f9b26d8f/users/d91835ad878c40a88472af70a9661e56/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.607081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f4febfe31a40c0a0812734f9b26d8f, user_id=d91835ad878c40a88472af70a9661e56, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.610294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.624681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1265/2505] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:02:22 2022] PUT /identity/v3/projects/e0f4febfe31a40c0a0812734f9b26d8f/users/d91835ad878c40a88472af70a9661e56/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:22.635505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.635798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.636278 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.668118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] MFA Rules not processed for user `d91835ad878c40a88472af70a9661e56`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:22.669368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:22.736416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1241/2506] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:22.740841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.802754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b8ca9-d006-40f6-a229-d6ae6a4d4a16 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.807572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.808234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.808516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.808820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.809517 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.811490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.839240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1266/2507] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:02:22.843441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.854280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700d8a4-e84b-4260-92e8-ab3a37ede1f0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.909247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.909944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.910230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.910500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.911188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.913097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.938115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1242/2508] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:02:22 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:02:22.939842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.950601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608d848-2dc0-49c7-b573-7022310e5850 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.957897 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.958798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.959085 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.959358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:22.960098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:22.961830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:22.976096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1267/2509] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:02:22.980165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:22.990066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f81047-3a44-4468-afb0-782c7c942ff5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:22.994652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:22.996307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:22.996831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:22.997168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] PATH_INFO: `/v3/projects/6c19f1bd4d234251aff17d618aad3da0/users/4d3f30f26bc34c7ab136c5b446eeacbc/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.012177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c19f1bd4d234251aff17d618aad3da0, user_id=4d3f30f26bc34c7ab136c5b446eeacbc, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:23.014860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:23.031541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1243/2510] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:02:22 2022] PUT /identity/v3/projects/6c19f1bd4d234251aff17d618aad3da0/users/4d3f30f26bc34c7ab136c5b446eeacbc/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:23.036265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:23.047857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b016-8ed6-4204-9705-3ea0f9e16a8e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:23.119542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177beee7-cd32-43d1-b6b0-7d88a37f95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:23.120235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177beee7-cd32-43d1-b6b0-7d88a37f95a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:23.120778 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177beee7-cd32-43d1-b6b0-7d88a37f95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:23.121042 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177beee7-cd32-43d1-b6b0-7d88a37f95a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.121766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177beee7-cd32-43d1-b6b0-7d88a37f95a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:23.123456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177beee7-cd32-43d1-b6b0-7d88a37f95a2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:23.134739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1268/2511] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:02:23.138816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:23.151746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6a92e-6333-47a0-a35c-1029024e1dcb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:23.156551 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:23.157659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:23.158211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:23.158500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] PATH_INFO: `/v3/projects/6c19f1bd4d234251aff17d618aad3da0/users/4d3f30f26bc34c7ab136c5b446eeacbc/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.160620 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c19f1bd4d234251aff17d618aad3da0, user_id=4d3f30f26bc34c7ab136c5b446eeacbc, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:23.163409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:23.175352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1244/2512] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:02:23 2022] PUT /identity/v3/projects/6c19f1bd4d234251aff17d618aad3da0/users/4d3f30f26bc34c7ab136c5b446eeacbc/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:23.186146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:23.186781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:23.187133 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.218057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] MFA Rules not processed for user `4d3f30f26bc34c7ab136c5b446eeacbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:23.219468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:23.292620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1269/2513] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:23.303684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:23.305375 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:23.361324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54931fb-7cdd-4cd5-9272-d4aea1f44f64 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:23.365062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:23.365773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:23.366145 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:23.366484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.375896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:23.377956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:23.387925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1245/2514] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:23.440975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:23.442750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:23.469548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:23.471123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:23.489812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3b582-e387-4d95-8056-2bd33d8dc6c9 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:23.493778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:23.494493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:23.494778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:23.495053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.512373 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a950-4fa7-4695-bfa7-547918dfc6f7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:23.516202 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:23.516887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:23.517902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:23.518184 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:23.520469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:23.556331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:23.557927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:23.568678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1246/2515] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:02:23.589665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:23.591664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:23.602645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1270/2516] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:24.436845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:24.438104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:24.454270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d1255-89d2-46a5-a4c9-8b3716a580a0 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:24.460601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:24.462009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:24.462631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:24.463912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] PATH_INFO: `/v3/users/674b1489365e4eaca838327326350448` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:24.465191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=674b1489365e4eaca838327326350448)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:24.467689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:24.526402 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674b1489365e4eaca838327326350448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.529827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674b1489365e4eaca838327326350448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.542672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674b1489365e4eaca838327326350448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.552163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674b1489365e4eaca838327326350448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.554194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674b1489365e4eaca838327326350448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.570680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1247/2517] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:24 2022] DELETE /identity/v3/users/674b1489365e4eaca838327326350448 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:24.746102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:24.759600 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7f4b-9c67-4fc6-bbe6-1b88af788169 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:24.831964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:24.832828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:24.833179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:24.833523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] PATH_INFO: `/v3/projects/d2bc35e5e5274a73a951b83dc562cdb1` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:24.834824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bc35e5e5274a73a951b83dc562cdb1)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:24.836818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:24.898159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bc35e5e5274a73a951b83dc562cdb1', 'request_id': 'req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.905283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bc35e5e5274a73a951b83dc562cdb1', 'request_id': 'req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.919123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bc35e5e5274a73a951b83dc562cdb1', 'request_id': 'req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.934406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] The token cache is being invalidate because project d2bc35e5e5274a73a951b83dc562cdb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:24.934765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.936215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:24.938325 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1271/2518] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:24 2022] DELETE /identity/v3/projects/d2bc35e5e5274a73a951b83dc562cdb1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:25.702973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:25.705308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:25.720750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd79d-6a5f-4197-8f5b-d95e4af295c3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:25.778573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:25.779446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:25.779732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:25.780009 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] PATH_INFO: `/v3/users/177b61c566a2483190032e0682aa647c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:25.795958 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] RBAC: Authorizing `identity:delete_user(user_id=177b61c566a2483190032e0682aa647c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:25.797931 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:25.844542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177b61c566a2483190032e0682aa647c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:25.845219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177b61c566a2483190032e0682aa647c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:25.856977 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177b61c566a2483190032e0682aa647c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:25.863973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177b61c566a2483190032e0682aa647c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:25.864621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177b61c566a2483190032e0682aa647c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:25.877699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1248/2519] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:25 2022] DELETE /identity/v3/users/177b61c566a2483190032e0682aa647c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:26.057208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:26.058745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:26.073627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ffe9-b76e-4dbc-beba-ea6a73731ec6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:26.144951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:26.145855 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:26.146148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:26.146422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] PATH_INFO: `/v3/projects/26dc4b166e3c42ef817a4bcd2cb5fdb0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:26.163653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dc4b166e3c42ef817a4bcd2cb5fdb0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:26.166017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:26.215929 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dc4b166e3c42ef817a4bcd2cb5fdb0', 'request_id': 'req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.222661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dc4b166e3c42ef817a4bcd2cb5fdb0', 'request_id': 'req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.228652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dc4b166e3c42ef817a4bcd2cb5fdb0', 'request_id': 'req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.241704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] The token cache is being invalidate because project 26dc4b166e3c42ef817a4bcd2cb5fdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:26.242186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.243098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.244656 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1272/2520] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:26 2022] DELETE /identity/v3/projects/26dc4b166e3c42ef817a4bcd2cb5fdb0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:02:26.248972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:26.250498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:26.265208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f282-4a2a-45bc-9d81-f8b891b2720d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:26.324247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:26.325140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:26.325422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:26.325698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] PATH_INFO: `/v3/users/18976da785ba4ce991c7ec7719752912` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:26.340902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=18976da785ba4ce991c7ec7719752912)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:26.342880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:26.398341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18976da785ba4ce991c7ec7719752912'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.399321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18976da785ba4ce991c7ec7719752912'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.413776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18976da785ba4ce991c7ec7719752912'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.420543 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18976da785ba4ce991c7ec7719752912'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.421345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18976da785ba4ce991c7ec7719752912'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.437246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1249/2521] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:26 2022] DELETE /identity/v3/users/18976da785ba4ce991c7ec7719752912 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:26.448806 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:26.451004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:26.467620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bf6b-a731-4040-abf2-2a564a2d9ceb admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:26.547171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:26.548992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:26.549290 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:26.549575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] PATH_INFO: `/v3/users/d91835ad878c40a88472af70a9661e56` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:26.551311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91835ad878c40a88472af70a9661e56)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:26.553508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:26.611793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91835ad878c40a88472af70a9661e56'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.612593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91835ad878c40a88472af70a9661e56'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.634989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91835ad878c40a88472af70a9661e56'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.646831 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91835ad878c40a88472af70a9661e56'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.647564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-54531afc-55a7-416e-864b-174909e8bc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91835ad878c40a88472af70a9661e56'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.660456 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:26.662666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:26.664678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1273/2522] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:26 2022] DELETE /identity/v3/users/d91835ad878c40a88472af70a9661e56 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:26.669625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435bec-d669-4948-aa35-23372b412549 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:26.669950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435bec-d669-4948-aa35-23372b412549 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:26.670352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435bec-d669-4948-aa35-23372b412549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:26.683978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882544c1-4d38-4ee2-b9e8-3c60739c83ad admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:26.699785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5f435bec-d669-4948-aa35-23372b412549 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:26.701330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5f435bec-d669-4948-aa35-23372b412549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:26.750685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:26.751781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:26.752707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:26.753434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] PATH_INFO: `/v3/projects/48cb339794a84cd9836214ed2d0ff1d9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:26.765972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cb339794a84cd9836214ed2d0ff1d9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:26.768476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:26.783942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1274/2523] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:02:26.795008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435bec-d669-4948-aa35-23372b412549 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:26.797144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5f435bec-d669-4948-aa35-23372b412549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:26.841573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cb339794a84cd9836214ed2d0ff1d9', 'request_id': 'req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.849452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cb339794a84cd9836214ed2d0ff1d9', 'request_id': 'req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.857574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cb339794a84cd9836214ed2d0ff1d9', 'request_id': 'req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.869680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435bec-d669-4948-aa35-23372b412549 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:26.875147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] The token cache is being invalidate because project 48cb339794a84cd9836214ed2d0ff1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:26.875665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.876828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:26.878778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1250/2524] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:26 2022] DELETE /identity/v3/projects/48cb339794a84cd9836214ed2d0ff1d9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:02:26.952645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:26.953340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:26.953628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:26.953949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:26.957028 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:27.036041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:27.037715 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:27.049427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1275/2525] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:02:27.362389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:27.364037 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:27.376828 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc30e-c9a7-4fe1-af4c-84c4e7c08fd2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:27.382475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:27.383562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:27.384018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:27.384465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] PATH_INFO: `/v3/projects/e0f4febfe31a40c0a0812734f9b26d8f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:27.385846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f4febfe31a40c0a0812734f9b26d8f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:27.388003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:27.440840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f4febfe31a40c0a0812734f9b26d8f', 'request_id': 'req-4b5bf18e-e52e-44ff-affd-4329b7d88a00'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.447580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f4febfe31a40c0a0812734f9b26d8f', 'request_id': 'req-4b5bf18e-e52e-44ff-affd-4329b7d88a00'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.457294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f4febfe31a40c0a0812734f9b26d8f', 'request_id': 'req-4b5bf18e-e52e-44ff-affd-4329b7d88a00'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.477210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] The token cache is being invalidate because project e0f4febfe31a40c0a0812734f9b26d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:27.477760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.478675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.480546 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1251/2526] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:27 2022] DELETE /identity/v3/projects/e0f4febfe31a40c0a0812734f9b26d8f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:27.484511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:27.495036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51029-fe93-44a4-b1e2-14246856a282 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:27.560621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:27.561584 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:27.561960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:27.562302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] PATH_INFO: `/v3/users/4d3f30f26bc34c7ab136c5b446eeacbc` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:27.563542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3f30f26bc34c7ab136c5b446eeacbc)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:27.566220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:27.614949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3f30f26bc34c7ab136c5b446eeacbc'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.615624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3f30f26bc34c7ab136c5b446eeacbc'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.627932 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3f30f26bc34c7ab136c5b446eeacbc'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.634406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3f30f26bc34c7ab136c5b446eeacbc'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.635107 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fc086929-b239-480f-a7ca-f56f4bdaa1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3f30f26bc34c7ab136c5b446eeacbc'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:27.647599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1276/2527] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:27 2022] DELETE /identity/v3/users/4d3f30f26bc34c7ab136c5b446eeacbc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:02:28.053522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.055398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:28.067941 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134e65-5429-460f-bcea-ac5209170472 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.068926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf18e-e52e-44ff-affd-4329b7d88a00 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.070908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134e65-5429-460f-bcea-ac5209170472 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.071207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134e65-5429-460f-bcea-ac5209170472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.090594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1a134e65-5429-460f-bcea-ac5209170472 None None] MFA Rules not processed for user `5441b55f8fbf4ff392afe0bb3d040d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:28.091821 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1a134e65-5429-460f-bcea-ac5209170472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:28.126008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.126881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.127186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.127455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] PATH_INFO: `/v3/projects/6c19f1bd4d234251aff17d618aad3da0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.128646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c19f1bd4d234251aff17d618aad3da0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.130587 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.147466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1277/2528] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:02:28.176866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c19f1bd4d234251aff17d618aad3da0', 'request_id': 'req-db94a0f2-eea7-41ad-b379-88eff7207448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:28.182894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c19f1bd4d234251aff17d618aad3da0', 'request_id': 'req-db94a0f2-eea7-41ad-b379-88eff7207448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:28.188202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c19f1bd4d234251aff17d618aad3da0', 'request_id': 'req-db94a0f2-eea7-41ad-b379-88eff7207448'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:28.201965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] The token cache is being invalidate because project 6c19f1bd4d234251aff17d618aad3da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:28.202355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:28.203152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-db94a0f2-eea7-41ad-b379-88eff7207448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:28.205396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1252/2529] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:28 2022] DELETE /identity/v3/projects/6c19f1bd4d234251aff17d618aad3da0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:28.210273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.210776 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.211059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.229634 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:28.230868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:28.300695 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1278/2530] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:02:28.302315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.302613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.302874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.321576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:28.322815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:28.331221 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1253/2531] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:02:28.335625 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.345849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538b901-869f-49de-bc1c-2e37eb0ffd86 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.350495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.351163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.351449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.351730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.352464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:02:28.352775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.354419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.366449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1279/2532] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:02:28.370714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.381490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2d14f-9869-460d-8ee3-36eb8c789aa8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.386202 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.386867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.387150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.387427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.388137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.390101 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.420377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1254/2533] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:02:28.421878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.432129 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759824-2894-48cb-9acf-625cf730365d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.492258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.492953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.493205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.493481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.494218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.496389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.516876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1280/2534] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:02:28.522231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.532288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec5fe-8e59-4cdb-bbea-f327a4809a94 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.536912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.537565 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.537878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.538160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.538889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.540474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.553298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1255/2535] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 19:02:28.554901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.566243 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b523c6-967b-4949-95d9-ac30bcbc980c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.571056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258eced-bdf7-48aa-b74d-c19ec3de9898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.571925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258eced-bdf7-48aa-b74d-c19ec3de9898 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.572214 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258eced-bdf7-48aa-b74d-c19ec3de9898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.572520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258eced-bdf7-48aa-b74d-c19ec3de9898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.573244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258eced-bdf7-48aa-b74d-c19ec3de9898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.574869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258eced-bdf7-48aa-b74d-c19ec3de9898 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.586225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1281/2536] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 19:02:28.590235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.600901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c612597-4abd-4c98-8e78-55efaa81f293 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.605645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.606619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.606970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.607313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] PATH_INFO: `/v3/projects/005f0b1245ed4ce08f6627a0c862e3b1/users/cb889c39cec64cb280bce03d512d75cd/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.622345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005f0b1245ed4ce08f6627a0c862e3b1, user_id=cb889c39cec64cb280bce03d512d75cd, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.624982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.638766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1256/2537] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:02:28 2022] PUT /identity/v3/projects/005f0b1245ed4ce08f6627a0c862e3b1/users/cb889c39cec64cb280bce03d512d75cd/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:28.651223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.651548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.651830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.678157 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] MFA Rules not processed for user `cb889c39cec64cb280bce03d512d75cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:28.679366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:28.751973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1282/2538] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:28.753310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.825881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798c3b2-d841-4d32-bd6e-758eddd8b759 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.831033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.831697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.831981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.832347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.833044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.835625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.871360 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1257/2539] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:02:28.875349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.886579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a88b5-d097-4449-97bb-8259554ec67e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.944645 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.945329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.945640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.945955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.946688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.948617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:28.968296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1283/2540] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:02:28 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:02:28.972599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:28.984274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878078-b8d8-4baa-b12a-3ae345fa184a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:28.990827 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:28.991495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:28.991780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:28.992058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:28.992794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:28.994436 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:29.005569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1258/2541] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:02:29.009684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:29.020588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1a4a5-0b88-4d52-bf01-0e747497ddc0 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:29.025487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:29.026465 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:29.026912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:29.027343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] PATH_INFO: `/v3/projects/3ddc293e3da1443487be98f5b66cde40/users/749a48677b2a479d97c50ce3f44b0600/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:29.045284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc293e3da1443487be98f5b66cde40, user_id=749a48677b2a479d97c50ce3f44b0600, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:29.048001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:29.061753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1284/2542] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:02:29 2022] PUT /identity/v3/projects/3ddc293e3da1443487be98f5b66cde40/users/749a48677b2a479d97c50ce3f44b0600/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:29.066773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:29.076489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713e0a-bc04-4534-8668-2ec7f8cc7030 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:29.140860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e101b5-2d83-4a8f-8f00-d0c02c2fea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:29.142405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e101b5-2d83-4a8f-8f00-d0c02c2fea5a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:29.142868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e101b5-2d83-4a8f-8f00-d0c02c2fea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:29.143241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e101b5-2d83-4a8f-8f00-d0c02c2fea5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:29.144046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e101b5-2d83-4a8f-8f00-d0c02c2fea5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:29.145771 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e101b5-2d83-4a8f-8f00-d0c02c2fea5a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:29.157423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1259/2543] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:02:29.162204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:29.172669 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f24fd-c760-4dac-bbbb-dfdb33e160c7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:29.177607 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:29.178522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:29.178867 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:29.179173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] PATH_INFO: `/v3/projects/3ddc293e3da1443487be98f5b66cde40/users/749a48677b2a479d97c50ce3f44b0600/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:29.181252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc293e3da1443487be98f5b66cde40, user_id=749a48677b2a479d97c50ce3f44b0600, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:29.183907 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:29.194293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1285/2544] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:02:29 2022] PUT /identity/v3/projects/3ddc293e3da1443487be98f5b66cde40/users/749a48677b2a479d97c50ce3f44b0600/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:29.205015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:29.205476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:29.206003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:29.233343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] MFA Rules not processed for user `749a48677b2a479d97c50ce3f44b0600`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:29.234566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:29.306697 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1260/2545] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:29.318285 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:29.320140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:29.387495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c342-6c2b-4b89-863c-6d13584b9632 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:29.391306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:29.392647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:29.392937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:29.393197 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:29.447719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:29.449141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:29.458730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1286/2546] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:35.068142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:35.077492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac842-a51c-4557-b210-b0f9c77b4f23 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:35.081168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bf9c0-c17e-47d7-af3d-1102d3135c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:35.081812 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bf9c0-c17e-47d7-af3d-1102d3135c04 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:35.082102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bf9c0-c17e-47d7-af3d-1102d3135c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:35.082376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bf9c0-c17e-47d7-af3d-1102d3135c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:35.090987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bf9c0-c17e-47d7-af3d-1102d3135c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:35.092398 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bf9c0-c17e-47d7-af3d-1102d3135c04 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:35.101680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1261/2547] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:58.736819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:58.795158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0b650-f5f4-404c-a286-d13a0aeedf6a service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:58.800729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:58.801604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:58.801931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:58.802216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] PATH_INFO: `/v3/users/cb889c39cec64cb280bce03d512d75cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:58.803401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb889c39cec64cb280bce03d512d75cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:58.805309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:58.852048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb889c39cec64cb280bce03d512d75cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:58.852703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb889c39cec64cb280bce03d512d75cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:58.864250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb889c39cec64cb280bce03d512d75cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:58.871256 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb889c39cec64cb280bce03d512d75cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:58.871910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb889c39cec64cb280bce03d512d75cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:58.884357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1287/2548] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:58 2022] DELETE /identity/v3/users/cb889c39cec64cb280bce03d512d75cd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:58.889454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:58.890000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:58.890230 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:58.908589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:02:58.909993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:58.966394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1262/2549] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:02:58.975787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:58.977165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:59.044020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc20438-49a2-4c19-8f25-b41f02195e60 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:59.047647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:59.049413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:59.049700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:59.050012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:59.058818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:59.060238 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:59.070623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1288/2550] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:02:59.335683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:59.337251 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:59.357250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055ffe-0618-4ca7-b70f-76909907142b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:59.362595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:59.363447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:59.363790 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:59.363995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] PATH_INFO: `/v3/projects/005f0b1245ed4ce08f6627a0c862e3b1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:59.365182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005f0b1245ed4ce08f6627a0c862e3b1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:59.367031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:59.411289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005f0b1245ed4ce08f6627a0c862e3b1', 'request_id': 'req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.417246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005f0b1245ed4ce08f6627a0c862e3b1', 'request_id': 'req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.423469 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005f0b1245ed4ce08f6627a0c862e3b1', 'request_id': 'req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.434955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] The token cache is being invalidate because project 005f0b1245ed4ce08f6627a0c862e3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:59.435246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.435870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.437404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1263/2551] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:59 2022] DELETE /identity/v3/projects/005f0b1245ed4ce08f6627a0c862e3b1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:59.441900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:59.451401 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7638-c78b-4295-98cf-004aec218992 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:59.507132 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:59.507928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:59.508207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:59.508477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] PATH_INFO: `/v3/users/749a48677b2a479d97c50ce3f44b0600` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:59.509661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=749a48677b2a479d97c50ce3f44b0600)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:59.511588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:59.554242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749a48677b2a479d97c50ce3f44b0600'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.554877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749a48677b2a479d97c50ce3f44b0600'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.565954 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749a48677b2a479d97c50ce3f44b0600'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.572277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749a48677b2a479d97c50ce3f44b0600'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.572894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8ee62fb8-5fce-48a5-b251-e79b86329b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749a48677b2a479d97c50ce3f44b0600'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.585477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1289/2552] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:02:59 2022] DELETE /identity/v3/users/749a48677b2a479d97c50ce3f44b0600 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:02:59.855198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:02:59.856788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:02:59.871165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2a02b-ef8e-4247-82cc-ae07297a9cc9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:02:59.927195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:02:59.928056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:02:59.928341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:02:59.928619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] PATH_INFO: `/v3/projects/3ddc293e3da1443487be98f5b66cde40` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:02:59.929821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddc293e3da1443487be98f5b66cde40)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:02:59.931758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:02:59.975722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddc293e3da1443487be98f5b66cde40', 'request_id': 'req-7d900fb2-c196-49d5-b2ed-fe700fb778e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.981577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddc293e3da1443487be98f5b66cde40', 'request_id': 'req-7d900fb2-c196-49d5-b2ed-fe700fb778e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.987618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddc293e3da1443487be98f5b66cde40', 'request_id': 'req-7d900fb2-c196-49d5-b2ed-fe700fb778e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:02:59.999226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] The token cache is being invalidate because project 3ddc293e3da1443487be98f5b66cde40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:02:59.999516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:00.000127 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d900fb2-c196-49d5-b2ed-fe700fb778e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:00.001817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1264/2553] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:02:59 2022] DELETE /identity/v3/projects/3ddc293e3da1443487be98f5b66cde40 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:00.007121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.007613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.007738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.025623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:00.026828 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:00.084494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1290/2554] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:03:00.092985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.093293 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.093571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.111752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:00.112929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:00.120995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1265/2555] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:00.125044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.134950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bb77e-693d-44e3-bdf7-cb6cdf6e8d26 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.139369 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.140010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.140295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.140566 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.141281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:03:00.142251 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.143817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.154775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1291/2556] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:03:00.158935 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.167874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed99b03-9985-48ad-bced-b58fecc17265 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.172419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.173053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.173329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.173597 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.174308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.176185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.200995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1266/2557] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/projects => generated 387 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:00.205832 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.215602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b7592-8144-47fc-b322-0d64560491da admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.269477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.270101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.270387 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.270660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.271345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.273237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.292586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1292/2558] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:03:00.296589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.307288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af3d8-c367-46d7-a0dc-31fe5cc8e306 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.311854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.312496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.312777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.313051 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.313845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.315417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.325408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1267/2559] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:00.329658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.339239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13337a4-c7ed-487e-abad-60368d16b947 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.343729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc124f-a760-4a98-96db-8cdc3952a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.344371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc124f-a760-4a98-96db-8cdc3952a190 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.345236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc124f-a760-4a98-96db-8cdc3952a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.345512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc124f-a760-4a98-96db-8cdc3952a190 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.346262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc124f-a760-4a98-96db-8cdc3952a190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.347835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc124f-a760-4a98-96db-8cdc3952a190 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.357419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1293/2560] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:00.361418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.371358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7058-004d-4195-8c37-7abc12afe758 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.376036 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.376796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.377079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.377358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] PATH_INFO: `/v3/projects/f372de1f231e49e5b0978a1408de9d31/users/9f31710f2c424d06a0e62ea8d5a2429a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.393125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f372de1f231e49e5b0978a1408de9d31, user_id=9f31710f2c424d06a0e62ea8d5a2429a, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.395784 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.408856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1268/2561] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:00 2022] PUT /identity/v3/projects/f372de1f231e49e5b0978a1408de9d31/users/9f31710f2c424d06a0e62ea8d5a2429a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:00.419043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.419366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.419650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.444994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] MFA Rules not processed for user `9f31710f2c424d06a0e62ea8d5a2429a`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:00.446237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:00.510140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1294/2562] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:00.514599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.574291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18816704-4cb9-47dc-8278-c2e1fff5cc82 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.578907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.580466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.580747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.581025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.581721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.583667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.607972 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1269/2563] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:00.612221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.622816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2680a-1548-41cc-b5d8-9a24e0cc3573 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.677431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.678123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.678411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.678692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.679389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.681297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.699960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1295/2564] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:00.703887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.714741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d777c79-4e28-409b-9b73-f1f400b94d05 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.719254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.720475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.720748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.721013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.721753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.723358 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.733588 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1270/2565] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:00.737574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.747571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59629643-6119-4f10-af9e-af40c68e5790 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.752865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040fdd1-3340-4dd1-be0e-7e67ca2571e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.753519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040fdd1-3340-4dd1-be0e-7e67ca2571e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.753829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040fdd1-3340-4dd1-be0e-7e67ca2571e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.754112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040fdd1-3340-4dd1-be0e-7e67ca2571e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.754839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040fdd1-3340-4dd1-be0e-7e67ca2571e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.756419 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040fdd1-3340-4dd1-be0e-7e67ca2571e7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.766079 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1296/2566] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:00.770636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.780564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bb13-dc67-4fdd-91ad-4550bc6dd324 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.785219 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.786128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.786540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.786826 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] PATH_INFO: `/v3/projects/07ca6d28fccb4949b6b0d247695810e3/users/66c44513dc304388b1e1a6b54cb956bf/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.801100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ca6d28fccb4949b6b0d247695810e3, user_id=66c44513dc304388b1e1a6b54cb956bf, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.803749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:00.817413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1271/2567] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:00 2022] PUT /identity/v3/projects/07ca6d28fccb4949b6b0d247695810e3/users/66c44513dc304388b1e1a6b54cb956bf/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:00.827648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.827901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.828155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.854071 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] MFA Rules not processed for user `66c44513dc304388b1e1a6b54cb956bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:00.855263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:00.918160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1297/2568] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:00.922752 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:00.980420 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4785-2a0e-471e-8774-b93da3b672d4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:00.985303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:00.985997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:00.986283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:00.986560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:00.987242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:00.989138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.014670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1272/2569] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:00 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:01.020092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:01.030389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0681a8-9959-4009-bbd6-3cd8451fac92 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:01.082810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:01.083398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.083677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.083955 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.084644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:01.086684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.106008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1298/2570] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:01 2022] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:01.109916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:01.121058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba2c00-3ef7-4b86-b60a-dddf141eb8b9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:01.125639 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:01.126893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.127185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.127493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.128216 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:01.129822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.140024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1273/2571] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:01.144137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:01.154087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4e432-1346-4c37-b053-5213b943d64f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:01.158654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:01.159518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.159795 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.160066 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] PATH_INFO: `/v3/projects/9ff9af84bf0b4f57b74013d1d91eccf0/users/8514c0c4445c4d63b1e3eef1a69be026/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.174800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff9af84bf0b4f57b74013d1d91eccf0, user_id=8514c0c4445c4d63b1e3eef1a69be026, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:01.177409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.190234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1299/2572] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:01 2022] PUT /identity/v3/projects/9ff9af84bf0b4f57b74013d1d91eccf0/users/8514c0c4445c4d63b1e3eef1a69be026/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:01.194352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:01.204248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c291-ab4a-47f7-bdbf-200109370f8d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:01.258965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed349c-db41-4564-ae2e-d241bd16cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:01.259626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed349c-db41-4564-ae2e-d241bd16cff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.259909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed349c-db41-4564-ae2e-d241bd16cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.260209 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed349c-db41-4564-ae2e-d241bd16cff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.260930 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed349c-db41-4564-ae2e-d241bd16cff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:01.262559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed349c-db41-4564-ae2e-d241bd16cff7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.271938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1274/2573] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:01.276138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:01.286144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1eb62-6642-40bb-ae44-17593ca2f829 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:01.290682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:01.291553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.291849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.292106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] PATH_INFO: `/v3/projects/9ff9af84bf0b4f57b74013d1d91eccf0/users/8514c0c4445c4d63b1e3eef1a69be026/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.294080 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff9af84bf0b4f57b74013d1d91eccf0, user_id=8514c0c4445c4d63b1e3eef1a69be026, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:01.296694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.307253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1300/2574] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:01 2022] PUT /identity/v3/projects/9ff9af84bf0b4f57b74013d1d91eccf0/users/8514c0c4445c4d63b1e3eef1a69be026/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:01.367610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.367861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.368077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.395300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] MFA Rules not processed for user `8514c0c4445c4d63b1e3eef1a69be026`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:01.396756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:01.463231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1275/2575] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:01.474319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:01.476087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:01.532788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d9a2a-c5c8-4f64-9e9e-d26f1acaaade admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:01.536370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:01.537004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:01.537283 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:01.537554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:01.546147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:01.547554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:01.557289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1301/2576] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:02.050320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:02.051720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:02.063217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2c867-de62-4266-8f83-bf7a5cc1a556 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:02.067452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:02.068079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:02.068359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:02.068633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:02.122497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:02.123913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:02.133091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1276/2577] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:06.070646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:06.079149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c40f-a5b5-490b-95ec-114fbb72d91a service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:06.083163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7c743-30f2-4de3-86e5-cbca20fb2cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:06.083799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c743-30f2-4de3-86e5-cbca20fb2cfa service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:06.084084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c743-30f2-4de3-86e5-cbca20fb2cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:06.084363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7c743-30f2-4de3-86e5-cbca20fb2cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:06.140258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7c743-30f2-4de3-86e5-cbca20fb2cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:06.141623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7c743-30f2-4de3-86e5-cbca20fb2cfa service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:06.150696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1302/2578] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:08.176854 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:08.235948 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fadbf-3613-431b-beb3-c6773f697a8f service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:08.240508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:08.241368 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:08.241649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:08.241965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] PATH_INFO: `/v3/users/9f31710f2c424d06a0e62ea8d5a2429a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:08.243136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f31710f2c424d06a0e62ea8d5a2429a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:08.245044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:08.289542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f31710f2c424d06a0e62ea8d5a2429a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.290176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f31710f2c424d06a0e62ea8d5a2429a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.301280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f31710f2c424d06a0e62ea8d5a2429a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.307859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f31710f2c424d06a0e62ea8d5a2429a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.308481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f31710f2c424d06a0e62ea8d5a2429a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.320757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1277/2579] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:03:08 2022] DELETE /identity/v3/users/9f31710f2c424d06a0e62ea8d5a2429a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:08.325231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:08.325743 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:08.325928 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:08.344759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:08.346046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:08.402772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1303/2580] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:03:08.412454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:08.413881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:08.468602 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66320611-299c-438d-88cb-5c60f14ad8fc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:08.472280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:08.472945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:08.473224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:08.473490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:08.482518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:08.483936 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:08.493175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1278/2581] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:08.749649 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:08.751092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:08.763193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaba34-8771-4a49-8fd9-856f28f5860d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:08.767857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:08.768960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:08.769356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:08.769639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] PATH_INFO: `/v3/projects/f372de1f231e49e5b0978a1408de9d31` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:08.771050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f372de1f231e49e5b0978a1408de9d31)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:08.773140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:08.819601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f372de1f231e49e5b0978a1408de9d31', 'request_id': 'req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.825631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f372de1f231e49e5b0978a1408de9d31', 'request_id': 'req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.831337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f372de1f231e49e5b0978a1408de9d31', 'request_id': 'req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.843310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] The token cache is being invalidate because project f372de1f231e49e5b0978a1408de9d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:03:08.843592 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.844245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.845820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1304/2582] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:03:08 2022] DELETE /identity/v3/projects/f372de1f231e49e5b0978a1408de9d31 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:03:08.849900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:08.859254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee657c-2c98-45f2-aee9-913d84196401 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:08.914633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:08.915640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:08.915981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:08.916263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] PATH_INFO: `/v3/users/66c44513dc304388b1e1a6b54cb956bf` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:08.917454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c44513dc304388b1e1a6b54cb956bf)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:08.919410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:08.963656 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c44513dc304388b1e1a6b54cb956bf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.964218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c44513dc304388b1e1a6b54cb956bf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.975701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c44513dc304388b1e1a6b54cb956bf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.982073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c44513dc304388b1e1a6b54cb956bf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.982701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c44513dc304388b1e1a6b54cb956bf'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:08.995502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1279/2583] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:03:08 2022] DELETE /identity/v3/users/66c44513dc304388b1e1a6b54cb956bf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:09.255777 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:09.257189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:09.270249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf88bb3-4e39-4248-9b57-6f329eb59ab2 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:09.325753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:09.326646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:09.326922 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:09.327192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] PATH_INFO: `/v3/projects/07ca6d28fccb4949b6b0d247695810e3` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:09.328364 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ca6d28fccb4949b6b0d247695810e3)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:09.330847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:09.373531 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ca6d28fccb4949b6b0d247695810e3', 'request_id': 'req-5b05a5f6-6817-4985-b218-f78e31266bc2'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.379638 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ca6d28fccb4949b6b0d247695810e3', 'request_id': 'req-5b05a5f6-6817-4985-b218-f78e31266bc2'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.385017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ca6d28fccb4949b6b0d247695810e3', 'request_id': 'req-5b05a5f6-6817-4985-b218-f78e31266bc2'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.397206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] The token cache is being invalidate because project 07ca6d28fccb4949b6b0d247695810e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:03:09.397521 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.398172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.399949 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1305/2584] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:03:09 2022] DELETE /identity/v3/projects/07ca6d28fccb4949b6b0d247695810e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:09.403731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:09.405117 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:09.418102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc88e-af44-47fd-b09a-a26c5b27184d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:09.471522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:09.472384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:09.472666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:09.472938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] PATH_INFO: `/v3/users/8514c0c4445c4d63b1e3eef1a69be026` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:09.474148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8514c0c4445c4d63b1e3eef1a69be026)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:09.476051 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:09.519249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8514c0c4445c4d63b1e3eef1a69be026'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.519816 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8514c0c4445c4d63b1e3eef1a69be026'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.530769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8514c0c4445c4d63b1e3eef1a69be026'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.538236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8514c0c4445c4d63b1e3eef1a69be026'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.538883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e5f315e9-8416-4c12-b180-2eae95e59b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8514c0c4445c4d63b1e3eef1a69be026'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.551079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1280/2585] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:03:09 2022] DELETE /identity/v3/users/8514c0c4445c4d63b1e3eef1a69be026 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:09.806712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:09.808284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:09.822322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05a5f6-6817-4985-b218-f78e31266bc2 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:09.878469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:09.879358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:09.879637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:09.879926 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] PATH_INFO: `/v3/projects/9ff9af84bf0b4f57b74013d1d91eccf0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:09.881068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff9af84bf0b4f57b74013d1d91eccf0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:09.882987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:09.926604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff9af84bf0b4f57b74013d1d91eccf0', 'request_id': 'req-1aa4dd5d-8b00-4e39-b743-313b627ffc03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.932350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff9af84bf0b4f57b74013d1d91eccf0', 'request_id': 'req-1aa4dd5d-8b00-4e39-b743-313b627ffc03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.937445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff9af84bf0b4f57b74013d1d91eccf0', 'request_id': 'req-1aa4dd5d-8b00-4e39-b743-313b627ffc03'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.949862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] The token cache is being invalidate because project 9ff9af84bf0b4f57b74013d1d91eccf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:03:09.950146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.950785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-1aa4dd5d-8b00-4e39-b743-313b627ffc03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:09.952510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1306/2586] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:03:09 2022] DELETE /identity/v3/projects/9ff9af84bf0b4f57b74013d1d91eccf0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:09.959077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:09.959364 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:09.959638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:09.977312 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:09.978514 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:10.035637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1281/2587] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:10.043836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.044148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.044429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.063036 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:10.064838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:10.072623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1307/2588] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:10.076686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.086058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb835f3-06cd-450c-ba18-b2e75ae1985d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.090515 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.091152 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.091437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.091714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.092430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:03:10.092731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.094337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.105439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1282/2589] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:03:10.109522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.119261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884ced-a5e1-4772-8178-74010aa7e89d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.124158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.124801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.125086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.125367 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.126103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.128836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.153142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1308/2590] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:10.157063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.166756 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8cf9a-f527-47c1-a55b-62b039053450 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.220817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.221478 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.221757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.222058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.222778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.224678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.245307 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1283/2591] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:03:10.249460 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.261570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cff8ef-eead-4bb2-9ac6-f5de9c996777 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.266208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.266880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.267324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.267690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.268421 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.270319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.280522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1309/2592] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 19:03:10.284516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.294225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b4469-7236-490c-a4c5-af9d6d51b3d8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.299314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf731a9-a654-42db-8415-82059dd7e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.299954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf731a9-a654-42db-8415-82059dd7e75a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.300231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf731a9-a654-42db-8415-82059dd7e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.300504 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf731a9-a654-42db-8415-82059dd7e75a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.301256 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf731a9-a654-42db-8415-82059dd7e75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.302879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf731a9-a654-42db-8415-82059dd7e75a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.312345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1284/2593] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:10.317293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.326936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ea5a-faa2-4c2a-bfb9-ef6c6771a0f0 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.331688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.332552 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.332836 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.333112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] PATH_INFO: `/v3/projects/f4e1a56a81a445548b19611f98f97969/users/bd9c1ee0809044b8a4fecace6e6a03f4/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.347110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e1a56a81a445548b19611f98f97969, user_id=bd9c1ee0809044b8a4fecace6e6a03f4, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.349732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.363705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1310/2594] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:10 2022] PUT /identity/v3/projects/f4e1a56a81a445548b19611f98f97969/users/bd9c1ee0809044b8a4fecace6e6a03f4/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:10.376184 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.376457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.377392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.402467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] MFA Rules not processed for user `bd9c1ee0809044b8a4fecace6e6a03f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:10.403659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:10.465644 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1285/2595] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:10.470110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.530846 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d2cd5-0511-4eed-9d63-03ebf3f72c1e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.536354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.537058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.537368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.537643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.538376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.540300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.565975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1311/2596] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:10.570263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.581072 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6c6ea-463d-4c50-8693-92f6f5408fb5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.636835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.637493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.637829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.638108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.638806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.640714 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.659737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1286/2597] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:03:10.663601 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.674403 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2eae-b8fb-4bc1-a788-e0474f7619cf admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.678942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.679591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.679873 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.680150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.680871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.682570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.692829 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1312/2598] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:10.696658 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.706673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38484d4-4874-40bd-a21f-3a09c8a6d507 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.711253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.712119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.712409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.712691 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] PATH_INFO: `/v3/projects/15d05f5c4e82410ebdf6090457062087/users/59212b8656ca49c085d263e950e79de0/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.727502 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d05f5c4e82410ebdf6090457062087, user_id=59212b8656ca49c085d263e950e79de0, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.730178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.743513 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1287/2599] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:10 2022] PUT /identity/v3/projects/15d05f5c4e82410ebdf6090457062087/users/59212b8656ca49c085d263e950e79de0/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:03:10.747617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.757247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148b10-d8ea-4152-a996-3074dee4314c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.811868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a9b68-a98c-434d-9885-b62c97863705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.812573 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9b68-a98c-434d-9885-b62c97863705 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.812812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9b68-a98c-434d-9885-b62c97863705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.813092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9b68-a98c-434d-9885-b62c97863705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.813882 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a9b68-a98c-434d-9885-b62c97863705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.815612 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a9b68-a98c-434d-9885-b62c97863705 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.825056 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1313/2600] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:10.829091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.839568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f39ea-7d60-4671-8075-a06354b37cd5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:10.844232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:10.845096 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.846046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.846330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] PATH_INFO: `/v3/projects/15d05f5c4e82410ebdf6090457062087/users/59212b8656ca49c085d263e950e79de0/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.848280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d05f5c4e82410ebdf6090457062087, user_id=59212b8656ca49c085d263e950e79de0, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:10.850922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:10.860953 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1288/2601] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:10 2022] PUT /identity/v3/projects/15d05f5c4e82410ebdf6090457062087/users/59212b8656ca49c085d263e950e79de0/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:10.871270 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:10.871558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:10.871862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:10.897693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] MFA Rules not processed for user `59212b8656ca49c085d263e950e79de0`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:10.898913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:10.963989 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1314/2602] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:10.975296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:10.976971 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:11.032030 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c400c5-e097-40e9-a74d-f436d640455b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:11.036634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958864b4-c47a-4c74-9625-d406afd188bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:11.037323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958864b4-c47a-4c74-9625-d406afd188bd service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:11.037609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958864b4-c47a-4c74-9625-d406afd188bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:11.037919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958864b4-c47a-4c74-9625-d406afd188bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:11.046805 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958864b4-c47a-4c74-9625-d406afd188bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:11.048228 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958864b4-c47a-4c74-9625-d406afd188bd service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:11.057442 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1289/2603] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:11.594839 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:11.661269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb0cb-6fd5-4631-8f1f-53575168a6d2 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:11.665764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:11.666661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:11.666948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:11.667224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] PATH_INFO: `/v3/users/bd9c1ee0809044b8a4fecace6e6a03f4` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:11.668402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9c1ee0809044b8a4fecace6e6a03f4)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:11.670361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:11.715311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9c1ee0809044b8a4fecace6e6a03f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:11.715956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9c1ee0809044b8a4fecace6e6a03f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:11.727698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9c1ee0809044b8a4fecace6e6a03f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:11.734163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9c1ee0809044b8a4fecace6e6a03f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:11.734798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9c1ee0809044b8a4fecace6e6a03f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:11.748636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1315/2604] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:03:11 2022] DELETE /identity/v3/users/bd9c1ee0809044b8a4fecace6e6a03f4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:11.754185 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:11.754701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:11.754815 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:11.771729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:11.772911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:11.830372 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1290/2605] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:03:11.839976 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:11.841408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:11.920189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f62c-0142-452b-b893-243f0324f2f0 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:11.924639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:11.925320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:11.925602 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:11.925914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:11.935050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:11.936459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:11.946338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1316/2606] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:12.203352 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:12.204940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:12.217182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd1711-046e-4570-81a3-9100393e8ab0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:12.222495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:12.223349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:12.223627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:12.223928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] PATH_INFO: `/v3/projects/f4e1a56a81a445548b19611f98f97969` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:12.225110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e1a56a81a445548b19611f98f97969)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:12.227053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:12.271048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e1a56a81a445548b19611f98f97969', 'request_id': 'req-cb28e803-2a5c-449a-a40c-2d0504f4627b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.276820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e1a56a81a445548b19611f98f97969', 'request_id': 'req-cb28e803-2a5c-449a-a40c-2d0504f4627b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.281891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e1a56a81a445548b19611f98f97969', 'request_id': 'req-cb28e803-2a5c-449a-a40c-2d0504f4627b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.293721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] The token cache is being invalidate because project f4e1a56a81a445548b19611f98f97969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:03:12.294042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.294654 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.296167 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1291/2607] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:03:12 2022] DELETE /identity/v3/projects/f4e1a56a81a445548b19611f98f97969 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:12.300877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:12.310330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f41a-4b7b-4842-a419-dbbe5d917309 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:12.365144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:12.366057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:12.366339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:12.366639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] PATH_INFO: `/v3/users/59212b8656ca49c085d263e950e79de0` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:12.367841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59212b8656ca49c085d263e950e79de0)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:12.369732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:12.415586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59212b8656ca49c085d263e950e79de0'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.416230 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59212b8656ca49c085d263e950e79de0'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.427400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59212b8656ca49c085d263e950e79de0'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.434011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59212b8656ca49c085d263e950e79de0'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.434647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-5483878c-b4fc-40e4-82c4-910975d1f1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59212b8656ca49c085d263e950e79de0'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.447039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1317/2608] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:03:12 2022] DELETE /identity/v3/users/59212b8656ca49c085d263e950e79de0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:12.708322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:12.709842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:12.724763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e803-2a5c-449a-a40c-2d0504f4627b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:12.783722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:12.784574 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:12.784862 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:12.785136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] PATH_INFO: `/v3/projects/15d05f5c4e82410ebdf6090457062087` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:12.786327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d05f5c4e82410ebdf6090457062087)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:12.788223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:12.832243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d05f5c4e82410ebdf6090457062087', 'request_id': 'req-47820e01-2d38-46c1-89cf-e3a7cdb5e377'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.837934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d05f5c4e82410ebdf6090457062087', 'request_id': 'req-47820e01-2d38-46c1-89cf-e3a7cdb5e377'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.843033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d05f5c4e82410ebdf6090457062087', 'request_id': 'req-47820e01-2d38-46c1-89cf-e3a7cdb5e377'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.854361 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] The token cache is being invalidate because project 15d05f5c4e82410ebdf6090457062087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:03:12.854645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.855255 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-47820e01-2d38-46c1-89cf-e3a7cdb5e377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:12.856761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1292/2609] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:03:12 2022] DELETE /identity/v3/projects/15d05f5c4e82410ebdf6090457062087 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:12.861753 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:12.862297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:12.862406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:12.880858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:12.882082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:12.939942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1318/2610] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:12.947792 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:12.948080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:12.948355 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:12.966753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:12.967892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:12.975959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1293/2611] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:12.980015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:12.989613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6c37-4136-4a0a-b455-d38babf6a17d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:12.994208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:12.994856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:12.995407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:12.995684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:12.996414 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:03:12.996720 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:12.998362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.010215 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1319/2612] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:03:13.014294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.024233 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21edb6-77be-40bf-a711-0e3e467aa1da None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.028997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.029633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.029951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.030226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.030906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.032900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.057273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1294/2613] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:13 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:13.061292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.072055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe23e4-97a0-4212-84bf-7c88e1519df5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.129431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.130125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.130402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.130674 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.131361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.133262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.151461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1320/2614] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:13 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:13.155599 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.165616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5bc26-b1bd-4d42-aa91-49afd4ef2183 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.170299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.170950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.171235 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.171511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.172236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.174595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.184617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1295/2615] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:13.188322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.198220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ddbc7-dc94-413a-ae12-400558a79f37 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.203223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf8f27-3261-48ab-b4c5-9e9b82df94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.203876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf8f27-3261-48ab-b4c5-9e9b82df94f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.204181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf8f27-3261-48ab-b4c5-9e9b82df94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.204444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf8f27-3261-48ab-b4c5-9e9b82df94f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.205714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf8f27-3261-48ab-b4c5-9e9b82df94f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.207334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf8f27-3261-48ab-b4c5-9e9b82df94f3 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.217104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1321/2616] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:13.221755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.231449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3478-c1d9-4081-9bbf-3ebc5080f7af admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.236703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.237643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.237959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.238262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] PATH_INFO: `/v3/projects/f4771c6eca4642aeaa007d867eb34731/users/97bde083b9594b4baccef77147601778/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.253022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4771c6eca4642aeaa007d867eb34731, user_id=97bde083b9594b4baccef77147601778, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.255667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.268129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1296/2617] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:13 2022] PUT /identity/v3/projects/f4771c6eca4642aeaa007d867eb34731/users/97bde083b9594b4baccef77147601778/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:13.279176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.279494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.279771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.305288 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] MFA Rules not processed for user `97bde083b9594b4baccef77147601778`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:13.306620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:13.369510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1322/2618] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:13.381822 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.384760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:13.440579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e2dae-f551-46cd-9e3e-19cf688e7e35 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.444267 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29defcca-a14f-4b75-bc93-0e9bfc47ebd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.444917 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29defcca-a14f-4b75-bc93-0e9bfc47ebd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.445198 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29defcca-a14f-4b75-bc93-0e9bfc47ebd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.445475 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29defcca-a14f-4b75-bc93-0e9bfc47ebd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.454291 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29defcca-a14f-4b75-bc93-0e9bfc47ebd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.455848 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29defcca-a14f-4b75-bc93-0e9bfc47ebd3 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.465498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1297/2619] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:13.486449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.548627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b49c-9790-4d4d-9687-73f5196c5542 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.553160 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.554069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.554376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.554668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] PATH_INFO: `/v3/users/97bde083b9594b4baccef77147601778` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.555860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97bde083b9594b4baccef77147601778)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.557760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.604437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97bde083b9594b4baccef77147601778'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:13.605113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97bde083b9594b4baccef77147601778'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:13.616901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97bde083b9594b4baccef77147601778'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:13.623796 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97bde083b9594b4baccef77147601778'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:13.624461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97bde083b9594b4baccef77147601778'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:13.637061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1323/2620] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:03:13 2022] DELETE /identity/v3/users/97bde083b9594b4baccef77147601778 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:13.641635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.641954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.642947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.660324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:13.661492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:13.716963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1298/2621] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:13.726603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:13.727942 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:13.782875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499654e-5b11-4d39-bff9-e6cdb857a31a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:13.786711 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add88b-e753-4438-98a5-f673965b9996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:13.787350 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add88b-e753-4438-98a5-f673965b9996 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:13.787632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add88b-e753-4438-98a5-f673965b9996 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:13.787908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add88b-e753-4438-98a5-f673965b9996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:13.796606 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add88b-e753-4438-98a5-f673965b9996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:13.798055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add88b-e753-4438-98a5-f673965b9996 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:13.807690 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1324/2622] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:14.062074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.063542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:14.075448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90bb60-2ded-4ae7-93bd-4e0400320c52 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.080730 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.081562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.081896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.082161 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] PATH_INFO: `/v3/projects/f4771c6eca4642aeaa007d867eb34731` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.090146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4771c6eca4642aeaa007d867eb34731)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.092113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.136889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4771c6eca4642aeaa007d867eb34731', 'request_id': 'req-6f2d8a31-3670-4b7f-8991-41e5dd157ece'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:14.143220 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4771c6eca4642aeaa007d867eb34731', 'request_id': 'req-6f2d8a31-3670-4b7f-8991-41e5dd157ece'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:14.148743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4771c6eca4642aeaa007d867eb34731', 'request_id': 'req-6f2d8a31-3670-4b7f-8991-41e5dd157ece'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:14.161246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] The token cache is being invalidate because project f4771c6eca4642aeaa007d867eb34731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:03:14.161540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:14.162181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6f2d8a31-3670-4b7f-8991-41e5dd157ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:03:14.163738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1299/2623] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:03:14 2022] DELETE /identity/v3/projects/f4771c6eca4642aeaa007d867eb34731 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:03:14.168686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb172-804f-4508-8c73-3a5144636693 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.169175 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb172-804f-4508-8c73-3a5144636693 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.169299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb172-804f-4508-8c73-3a5144636693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.186816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-75feb172-804f-4508-8c73-3a5144636693 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:14.187997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-75feb172-804f-4508-8c73-3a5144636693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:14.245390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1325/2624] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:14.253524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.253842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.254147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.272576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:14.273746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:14.281945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1300/2625] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:14.290341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb172-804f-4508-8c73-3a5144636693 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.305212 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb172-804f-4508-8c73-3a5144636693 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.312100 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.312739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.313018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.317670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.318427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:03:14.318732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.320305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.332076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1326/2626] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:03:14.336272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.345381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a57eb-433e-4410-b9f8-e9adf06afef9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.350158 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.350800 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.351084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.351362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.352085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.354000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.378518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1301/2627] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:03:14 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:14.382580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.392799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d8ae-d290-494a-a5d2-470bbea68f79 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.447181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.447871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.448151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.448501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.449091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.451008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.478893 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1327/2628] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:03:14 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:03:14.480085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.490294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a9661-2f8f-446c-8c97-68b041589e78 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.494890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.495852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.496087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.496366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.497092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.498717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.509454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1302/2629] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:14.513404 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.523450 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b61ca4-2ac1-4222-b0a7-6c4f5ed2626c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.528048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3bf63-a627-486b-9380-48fda4d0c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.528706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3bf63-a627-486b-9380-48fda4d0c009 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.528991 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3bf63-a627-486b-9380-48fda4d0c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.529271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3bf63-a627-486b-9380-48fda4d0c009 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.530037 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3bf63-a627-486b-9380-48fda4d0c009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.531640 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3bf63-a627-486b-9380-48fda4d0c009 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.541908 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1328/2630] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:03:14.545923 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.556842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3870e5-2435-4bcb-a6f5-28c9ef4fb2ab admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.561394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.562296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.562579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.562856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] PATH_INFO: `/v3/projects/7fddf0ae030d499b8c226e43e57098ad/users/9fc6c29274234d228076aafbf83b5ad5/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.577429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fddf0ae030d499b8c226e43e57098ad, user_id=9fc6c29274234d228076aafbf83b5ad5, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.580670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.592994 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1303/2631] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:03:14 2022] PUT /identity/v3/projects/7fddf0ae030d499b8c226e43e57098ad/users/9fc6c29274234d228076aafbf83b5ad5/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:03:14.598758 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244d69-680d-43cd-8d7d-ff61460cba68 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.599057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244d69-680d-43cd-8d7d-ff61460cba68 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.599345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244d69-680d-43cd-8d7d-ff61460cba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.617176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e8244d69-680d-43cd-8d7d-ff61460cba68 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:14.618398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e8244d69-680d-43cd-8d7d-ff61460cba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:14.675676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1329/2632] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:03:14.685238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:14.686956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:14.741371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5a589-ad61-4c12-86d0-5940a4c34896 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:14.744998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:14.745982 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:14.746294 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:14.746650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:14.755832 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:14.757248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:14.766592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1304/2633] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:15.326903 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680ee5-c3b7-4115-95f4-01827e9aa29e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:15.327432 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680ee5-c3b7-4115-95f4-01827e9aa29e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:15.327585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680ee5-c3b7-4115-95f4-01827e9aa29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:15.353595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-d8680ee5-c3b7-4115-95f4-01827e9aa29e None None] MFA Rules not processed for user `9fc6c29274234d228076aafbf83b5ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:15.354885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d8680ee5-c3b7-4115-95f4-01827e9aa29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:15.419307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1330/2634] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:15.431864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:15.433401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:15.500956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b0b6-c68a-4e07-9bff-acbf0657e969 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:15.504801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:15.505449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:15.505762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:15.506086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:15.515200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:15.516747 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:15.526120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1305/2635] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:16.856196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:16.856744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:16.856853 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:16.874813 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] MFA Rules not processed for user `9fc6c29274234d228076aafbf83b5ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:16.876023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:16.883702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1331/2636] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:21.769224 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:21.778840 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334594d-5be2-4a67-b418-5c9d0d7f053f service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:21.782575 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:21.783518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:21.783866 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:21.784141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:21.786061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:21.849094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:21.855415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:21.860956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1306/2637] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:22.651830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:22.653415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:22.665334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d44b6-756e-4fd0-8571-668535a642f1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:22.668958 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:22.669672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:22.670051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:22.670393 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:22.672216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:22.746636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:22.748156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:22.760473 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1332/2638] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:22.852550 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:22.854159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:22.867554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf2724-bb79-40b0-91d4-fcf263df4b88 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:22.871558 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:22.872280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:22.872641 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:22.872997 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:22.874955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:22.890716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:22.893115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:22.904174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1307/2639] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:03:24.108647 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:24.119295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dfa6f-d7d3-419c-ab1b-287ba5e9671e service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:24.123223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:24.123872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:24.124154 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:24.124440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:24.126379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:24.136237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:24.137681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:24.146713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1333/2640] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:24.147043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:24.156468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7dd2-2173-41a1-af24-84b6e82163ad service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:24.160965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c64989-b0ae-44d2-af5e-b393bad51341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:24.161621 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c64989-b0ae-44d2-af5e-b393bad51341 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:24.161944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c64989-b0ae-44d2-af5e-b393bad51341 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:24.162227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c64989-b0ae-44d2-af5e-b393bad51341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:24.170479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c64989-b0ae-44d2-af5e-b393bad51341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:24.171912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c64989-b0ae-44d2-af5e-b393bad51341 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:24.198024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1308/2641] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:03:25.371097 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:25.375249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:25.404299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d4cc6-6878-4876-bb01-78d30fbf1a15 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:25.416547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:25.416547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:25.416547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:25.416547 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:25.419456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:25.433229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:25.434957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:25.446146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1334/2642] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:36.798306 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:36.798929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:36.798929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:36.815829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] MFA Rules not processed for user `5441b55f8fbf4ff392afe0bb3d040d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:36.816993 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:36.870181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1309/2643] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:36.882343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:36.893425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35882f2a-02cb-4029-89b1-70779367ec3b service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:36.899172 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:36.899884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:36.900229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:36.900379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:36.902374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:36.915304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:36.916878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5f1dc-e255-4996-bcbb-6e2881300990 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:36.928574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1335/2644] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:37.223155 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:37.232390 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad06a1c-c825-4d0f-9199-aca2441158d5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:37.236869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:37.237500 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:37.237785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:37.238091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:37.239833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:37.249253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:37.251785 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:37.259518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1310/2645] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:37.829112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfa540-88fe-42e0-a7de-64e91586c642 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:37.829590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfa540-88fe-42e0-a7de-64e91586c642 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:37.829937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfa540-88fe-42e0-a7de-64e91586c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:37.847624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2dbfa540-88fe-42e0-a7de-64e91586c642 None None] MFA Rules not processed for user `9fc6c29274234d228076aafbf83b5ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:37.848834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2dbfa540-88fe-42e0-a7de-64e91586c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:37.855965 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1336/2646] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:03:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:03:38.091003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:38.099703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57304e7-bc54-4a2d-bb84-9bb42a3ece6f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:38.103292 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:38.103922 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:38.104199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:38.104474 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:38.106234 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:38.116285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:38.117727 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:38.126770 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1311/2647] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:03:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:03:59.245182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768aed-8445-4496-bce1-36e4d9d334f8 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:59.245646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768aed-8445-4496-bce1-36e4d9d334f8 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:59.245764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768aed-8445-4496-bce1-36e4d9d334f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:59.308833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-0e768aed-8445-4496-bce1-36e4d9d334f8 None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:03:59.310072 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-0e768aed-8445-4496-bce1-36e4d9d334f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:59.373803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1337/2648] 10.222.0.84 () {58 vars in 1009 bytes} [Fri May 13 19:03:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:03:59.422387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:03:59.423780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:03:59.512542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1fbe-a95f-4217-aab1-6e9c410d8ffa service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:03:59.518310 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:03:59.518954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:03:59.519237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:03:59.519516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:03:59.527446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:03:59.529043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:03:59.536871 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1312/2649] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 19:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 19:04:14.738469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:14.738981 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:14.739092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:14.756445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] MFA Rules not processed for user `31f30b58e64c45beb61a9ec51c9526da`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:04:14.757633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:14.765380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1338/2650] 10.222.0.84 () {58 vars in 967 bytes} [Fri May 13 19:04:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:04:14.778045 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:04:14.788131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1df18c-9f1f-4786-bd89-14b97f4b9955 service swift] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:04:14.793052 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8d13580356499dafd5a8eaa7b14d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:04:14.793671 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:14.793976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:14.794250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:14.802794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:04:14.804337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:04:14.812711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1313/2651] 10.222.0.84 () {60 vars in 1384 bytes} [Fri May 13 19:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 19:04:16.715452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:04:16.729533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca221e-67c0-4d1c-a334-6505ee23f52b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:04:16.734250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:04:16.735118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:16.735400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:16.735675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] PATH_INFO: `/v3/users/9fc6c29274234d228076aafbf83b5ad5` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:16.736858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc6c29274234d228076aafbf83b5ad5)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:04:16.738803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:04:16.784433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc6c29274234d228076aafbf83b5ad5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:16.785086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc6c29274234d228076aafbf83b5ad5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:16.797323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc6c29274234d228076aafbf83b5ad5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:16.803864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc6c29274234d228076aafbf83b5ad5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:16.804504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-4a2f0fed-6c29-4b35-bdc9-d244744a7f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc6c29274234d228076aafbf83b5ad5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:16.817302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1339/2652] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:04:16 2022] DELETE /identity/v3/users/9fc6c29274234d228076aafbf83b5ad5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:04:16.988050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:04:17.001729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d382-25ae-44cb-9226-eac3f280fe9a service swift] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:04:17.055411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:04:17.056250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:17.056529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:17.056796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] PATH_INFO: `/v3/projects/7fddf0ae030d499b8c226e43e57098ad` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:17.057986 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fddf0ae030d499b8c226e43e57098ad)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:04:17.059860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:04:17.102834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fddf0ae030d499b8c226e43e57098ad', 'request_id': 'req-73622ea2-f894-4295-8eb7-9c1d476d4636'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:17.109063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fddf0ae030d499b8c226e43e57098ad', 'request_id': 'req-73622ea2-f894-4295-8eb7-9c1d476d4636'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:17.114461 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fddf0ae030d499b8c226e43e57098ad', 'request_id': 'req-73622ea2-f894-4295-8eb7-9c1d476d4636'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:17.126765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] The token cache is being invalidate because project 7fddf0ae030d499b8c226e43e57098ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:04:17.127051 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:17.127666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:04:17.129180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1314/2653] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:04:16 2022] DELETE /identity/v3/projects/7fddf0ae030d499b8c226e43e57098ad => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:04:43.063297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:43.063856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:43.063856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:43.082936 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] MFA Rules not processed for user `5441b55f8fbf4ff392afe0bb3d040d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:04:43.084173 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:43.141063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1340/2654] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:04:43.727102 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:04:43.728618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:43.799796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622ea2-f894-4295-8eb7-9c1d476d4636 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:04:43.804944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:04:43.805589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:43.805907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:43.806188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:43.807949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:43.819401 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:04:43.820965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:04:43.831193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1315/2655] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:04:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:04:50.585166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:04:50.586632 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:50.660242 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76dac-26a5-40a0-9c43-4941c038073e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:04:50.665668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:04:50.666395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:50.666633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:50.666911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:50.668677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:50.680984 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:04:50.682657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:04:50.693527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1341/2656] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:04:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:04:53.223666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:04:53.238759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9cb66-4002-46be-8ad8-648e80535256 service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:04:53.246178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:04:53.246892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:04:53.247613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:04:53.247613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:04:53.249382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:04:53.262422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:04:53.263996 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:04:53.275327 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1316/2657] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:04:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:46.831032 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:46.832520 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:46.887865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3be895-4617-44e2-b391-53bf9634a259 service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:46.891402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:46.892030 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:46.892309 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:46.892577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:46.894319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:46.953357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:46.954818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:46.964137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1342/2658] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:50.154851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:50.156841 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:50.171720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf9d0-b516-4b51-a876-60d1507404ec service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:50.177132 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:50.178140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:50.178530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:50.179001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] PATH_INFO: `/v3/users/5441b55f8fbf4ff392afe0bb3d040d71` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:50.180579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5441b55f8fbf4ff392afe0bb3d040d71)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:50.182559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:50.231146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5441b55f8fbf4ff392afe0bb3d040d71'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.231845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5441b55f8fbf4ff392afe0bb3d040d71'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.244689 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5441b55f8fbf4ff392afe0bb3d040d71'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.251883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5441b55f8fbf4ff392afe0bb3d040d71'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.252717 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-21658687-213e-4916-89ab-62a8ee69349b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5441b55f8fbf4ff392afe0bb3d040d71'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.266581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1317/2659] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:05:50 2022] DELETE /identity/v3/users/5441b55f8fbf4ff392afe0bb3d040d71 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:50.668204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:50.683788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e752-4a79-41c6-8b89-c9b6cc4480c7 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:50.741312 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:50.742147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:50.742453 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:50.742731 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] PATH_INFO: `/v3/projects/77692989da6e4c409bd09d68235495e3` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:50.743904 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77692989da6e4c409bd09d68235495e3)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:50.746096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:50.790398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77692989da6e4c409bd09d68235495e3', 'request_id': 'req-b717aa0d-195e-4713-9242-3eb81d4ecb34'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.796400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77692989da6e4c409bd09d68235495e3', 'request_id': 'req-b717aa0d-195e-4713-9242-3eb81d4ecb34'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.802358 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77692989da6e4c409bd09d68235495e3', 'request_id': 'req-b717aa0d-195e-4713-9242-3eb81d4ecb34'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.814257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] The token cache is being invalidate because project 77692989da6e4c409bd09d68235495e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:05:50.814541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.815150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b717aa0d-195e-4713-9242-3eb81d4ecb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:50.816819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1343/2660] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:05:50 2022] DELETE /identity/v3/projects/77692989da6e4c409bd09d68235495e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:50.821964 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:50.822343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:50.822766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:50.841624 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:50.842849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:50.902390 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1318/2661] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:50.910624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:50.910931 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:50.911217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:50.928905 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:50.930136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:50.938314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1344/2662] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:50.942405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:50.951787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973e9f8-3213-4c4f-a9e0-f6ae10e7cff3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:50.956214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:50.957408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:50.957695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:50.957998 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:50.958720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:05:50.959019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:50.960594 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:50.971542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1319/2663] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:05:50.976518 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:50.985651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10f91-1464-4d45-a271-3083d5e51cee None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:50.991740 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:50.992568 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:50.992894 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:50.993239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:50.993966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:50.996148 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.022001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1345/2664] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:05:50 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:51.026103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.036011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6d80-35e6-47f1-a4aa-254147f38edc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.090003 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.090704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.090988 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.091268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.091949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.093873 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.112033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1320/2665] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:05:51 2022] POST /identity/v3/users => generated 296 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:51.116650 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.126948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5d7c7-85c0-4d08-bedc-99b6fba91433 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.132682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.133336 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.133621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.133947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.134665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.136253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.146706 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1346/2666] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:51.150528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.160865 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c8e0-7bc0-4f3f-a9c9-7c65d9de3884 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.165633 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac174a-c2cc-46d4-8ff4-82a825f2e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.166313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac174a-c2cc-46d4-8ff4-82a825f2e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.166665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac174a-c2cc-46d4-8ff4-82a825f2e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.166909 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac174a-c2cc-46d4-8ff4-82a825f2e8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.167617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac174a-c2cc-46d4-8ff4-82a825f2e8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.169188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac174a-c2cc-46d4-8ff4-82a825f2e8f8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.179631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1321/2667] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:51.183896 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.193662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d215e-3fd1-41bb-9262-194d8ff607fd admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.198240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.199134 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.199413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.199687 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] PATH_INFO: `/v3/projects/54c1fb75e20c45fb82a834672cdfd7ae/users/07745b68c88941ccb46da5048fe23875/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.214102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c1fb75e20c45fb82a834672cdfd7ae, user_id=07745b68c88941ccb46da5048fe23875, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.216727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.229447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1347/2668] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:51 2022] PUT /identity/v3/projects/54c1fb75e20c45fb82a834672cdfd7ae/users/07745b68c88941ccb46da5048fe23875/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:51.239915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.240208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.240492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.266078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] MFA Rules not processed for user `07745b68c88941ccb46da5048fe23875`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:51.267195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:51.329089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1322/2669] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:51.333544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.391951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7fd91-fec2-4f30-a1b9-d6e2ca2add64 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.397329 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.398010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.398291 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.398563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.399253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.401144 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.425276 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1348/2670] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:05:51 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:51.429526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.440526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0bba-5502-4d06-a8e9-719dc3cf6652 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.495568 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.496232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.496518 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.496794 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.497476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.499492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.518835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1323/2671] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:05:51 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:51.523459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.533407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32f41-e58f-4e61-9489-9a396c150c81 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.538000 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.538646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.538925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.539198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.539912 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.541477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.552782 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1349/2672] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 19:05:51.556712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.567095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890217-8f8d-4700-a97d-534c923f531a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.571924 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.572795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.573078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.573351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] PATH_INFO: `/v3/projects/bb0cc65b9f124e42acb982ad7634c9f6/users/132b3d82e17b419b85cd02d6ab0bfea8/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.588501 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0cc65b9f124e42acb982ad7634c9f6, user_id=132b3d82e17b419b85cd02d6ab0bfea8, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.591165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.603192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1324/2673] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:51 2022] PUT /identity/v3/projects/bb0cc65b9f124e42acb982ad7634c9f6/users/132b3d82e17b419b85cd02d6ab0bfea8/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:51.607048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.617260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5a698-000b-43be-adbc-06d2ce79b440 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.669437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb9811-c080-456b-a1e8-8e6a2a03d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.670116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb9811-c080-456b-a1e8-8e6a2a03d19f admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.670398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb9811-c080-456b-a1e8-8e6a2a03d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.670668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb9811-c080-456b-a1e8-8e6a2a03d19f admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.671376 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb9811-c080-456b-a1e8-8e6a2a03d19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.672939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb9811-c080-456b-a1e8-8e6a2a03d19f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.683240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1350/2674] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:51.687318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.698025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b3214-967d-4f48-8280-eaf3cff968ef admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.702562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.703419 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.703700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.703970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] PATH_INFO: `/v3/projects/bb0cc65b9f124e42acb982ad7634c9f6/users/132b3d82e17b419b85cd02d6ab0bfea8/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.706027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0cc65b9f124e42acb982ad7634c9f6, user_id=132b3d82e17b419b85cd02d6ab0bfea8, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.708721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.718416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1325/2675] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:51 2022] PUT /identity/v3/projects/bb0cc65b9f124e42acb982ad7634c9f6/users/132b3d82e17b419b85cd02d6ab0bfea8/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:51.729149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.729440 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.729722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.757069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] MFA Rules not processed for user `132b3d82e17b419b85cd02d6ab0bfea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:51.758310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:51.825303 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1351/2676] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:51.836026 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.837789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:51.906169 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e2331-f861-4598-9545-ba14c7e907ff admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.909779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.911094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.911376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.911651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:51.920657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:51.922097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:51.932023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1326/2677] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:51.978232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:51.979613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:51.991874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ca97-26d5-433e-b411-9cdfcfd729b7 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:51.996333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5d0f9-fc3f-4f9b-bd18-975c661b69ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:51.996968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d0f9-fc3f-4f9b-bd18-975c661b69ca service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:51.997252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d0f9-fc3f-4f9b-bd18-975c661b69ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:51.997529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d0f9-fc3f-4f9b-bd18-975c661b69ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:52.055206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5d0f9-fc3f-4f9b-bd18-975c661b69ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:52.056648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5d0f9-fc3f-4f9b-bd18-975c661b69ca service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:52.065365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1352/2678] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:55.245261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:55.303975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e9792-bedf-40ce-ac78-0dea2ac79c53 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:55.308342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:55.309190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:55.309471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:55.309746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] PATH_INFO: `/v3/users/07745b68c88941ccb46da5048fe23875` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:55.310940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07745b68c88941ccb46da5048fe23875)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:55.312829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:55.358481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07745b68c88941ccb46da5048fe23875'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.359125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07745b68c88941ccb46da5048fe23875'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.370758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07745b68c88941ccb46da5048fe23875'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.377245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07745b68c88941ccb46da5048fe23875'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.377897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07745b68c88941ccb46da5048fe23875'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.389839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1327/2679] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:05:55 2022] DELETE /identity/v3/users/07745b68c88941ccb46da5048fe23875 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:55.395048 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:55.395523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:55.395628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:55.413221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:55.414449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:55.471159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1353/2680] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:55.482097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:55.483516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:55.539058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab358b-ffa4-42b6-82e3-88e6cf662da5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:55.542716 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:55.543362 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:55.543646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:55.543921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:55.553223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:55.554742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:55.563825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1328/2681] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:55.816510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:55.817999 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:55.831220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf6e3c-471f-4fc8-aa8a-17735b9b9133 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:55.836644 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:55.838179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:55.838636 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:55.838920 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] PATH_INFO: `/v3/projects/54c1fb75e20c45fb82a834672cdfd7ae` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:55.840121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c1fb75e20c45fb82a834672cdfd7ae)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:55.842068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:55.887688 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c1fb75e20c45fb82a834672cdfd7ae', 'request_id': 'req-f4422ba1-380c-4530-96f3-5bb7104df3f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.893970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c1fb75e20c45fb82a834672cdfd7ae', 'request_id': 'req-f4422ba1-380c-4530-96f3-5bb7104df3f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.900548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c1fb75e20c45fb82a834672cdfd7ae', 'request_id': 'req-f4422ba1-380c-4530-96f3-5bb7104df3f4'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.913394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] The token cache is being invalidate because project 54c1fb75e20c45fb82a834672cdfd7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:05:55.913684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.914328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:55.915877 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1354/2682] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:05:55 2022] DELETE /identity/v3/projects/54c1fb75e20c45fb82a834672cdfd7ae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:55.919839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:55.929960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059a71f-6f8b-447c-9ce3-c64a04b702dc service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:55.983527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:55.984598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:55.984887 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:55.985183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] PATH_INFO: `/v3/users/132b3d82e17b419b85cd02d6ab0bfea8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:55.986397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132b3d82e17b419b85cd02d6ab0bfea8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:55.989285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.033817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132b3d82e17b419b85cd02d6ab0bfea8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.034484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132b3d82e17b419b85cd02d6ab0bfea8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.046536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132b3d82e17b419b85cd02d6ab0bfea8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.053242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132b3d82e17b419b85cd02d6ab0bfea8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.053906 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b796faea-b92f-41ee-9f94-5ef17eb1e098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132b3d82e17b419b85cd02d6ab0bfea8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.065777 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1329/2683] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:05:55 2022] DELETE /identity/v3/users/132b3d82e17b419b85cd02d6ab0bfea8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:56.326299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.327716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:56.341105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422ba1-380c-4530-96f3-5bb7104df3f4 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.401359 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.402330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.402613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.402887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] PATH_INFO: `/v3/projects/bb0cc65b9f124e42acb982ad7634c9f6` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.404086 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0cc65b9f124e42acb982ad7634c9f6)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.406179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.452760 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0cc65b9f124e42acb982ad7634c9f6', 'request_id': 'req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.459973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0cc65b9f124e42acb982ad7634c9f6', 'request_id': 'req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.465754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0cc65b9f124e42acb982ad7634c9f6', 'request_id': 'req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.480223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] The token cache is being invalidate because project bb0cc65b9f124e42acb982ad7634c9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:05:56.480539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.481177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2be74ee9-1d2c-4171-9507-cbc6c8fa27ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:56.482820 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1355/2684] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:05:56 2022] DELETE /identity/v3/projects/bb0cc65b9f124e42acb982ad7634c9f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:56.487721 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.488242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.488313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.508325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:56.509635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:56.569223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1330/2685] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:56.576652 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.577061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.577415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.596311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:56.598754 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:56.606206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1356/2686] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:56.610408 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.620525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df9c64-33a6-4857-86a9-731dea4bb9ee None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.625390 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.626086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.626484 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.626796 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.627526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:05:56.627839 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.630118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.643002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1331/2687] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:05:56.648710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.658004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee35ca7-9deb-4d40-991b-6b75a16810ce None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.663590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.664258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.664537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.664810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.665509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.667637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.693610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1357/2688] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:05:56 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:56.697679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.708142 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88ba28-1e4f-4352-bad3-954a33c0b37e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.760366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.761016 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.761297 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.761572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.762296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.764183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.784445 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1332/2689] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:05:56 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:56.788637 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.798818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e3f90-53c4-4a92-bf9c-6df3ed7dbe53 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.804454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.805113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.805400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.805679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.806441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.808090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.819430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1358/2690] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:56.823050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.833080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547e2a-390a-4655-84b3-eb309c3d502d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.837678 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928c3a7-7681-4dea-bf4d-01de0b4b5970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.838351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928c3a7-7681-4dea-bf4d-01de0b4b5970 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.838635 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928c3a7-7681-4dea-bf4d-01de0b4b5970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.838910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928c3a7-7681-4dea-bf4d-01de0b4b5970 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.839632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928c3a7-7681-4dea-bf4d-01de0b4b5970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.841208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928c3a7-7681-4dea-bf4d-01de0b4b5970 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.851944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1333/2691] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 19:05:56.855804 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:56.866231 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7c6d-e3b7-4606-bb75-a6024d34ad1b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:56.871236 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:56.872112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.872397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.872677 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] PATH_INFO: `/v3/projects/487ef04ac4d4497c93634e4b397393d6/users/99a6e8cd3b3c42e984dad1872df9a253/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.887426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487ef04ac4d4497c93634e4b397393d6, user_id=99a6e8cd3b3c42e984dad1872df9a253, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:56.890064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:56.902104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1359/2692] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:56 2022] PUT /identity/v3/projects/487ef04ac4d4497c93634e4b397393d6/users/99a6e8cd3b3c42e984dad1872df9a253/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:56.913476 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:56.913766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:56.914069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:56.940406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] MFA Rules not processed for user `99a6e8cd3b3c42e984dad1872df9a253`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:56.942548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:57.003630 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1334/2693] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:57.008296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.068670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2721-39d7-4349-8da4-d83018103e00 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.073380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.074007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.074295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.074571 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.075254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.077141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.103043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1360/2694] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:05:57 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:57.107058 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.117410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7f6fa-dd43-4afe-87f0-5fe3d298750f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.172211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.172878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.173160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.173440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.174168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.176190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.197079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1335/2695] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:05:57 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:57.200781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.211582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca80-a650-435f-babf-f353e834814e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.217646 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.218478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.218793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.219179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.219906 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.221488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.232278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1361/2696] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:57.236342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.246896 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136f60-c409-418d-a249-4f0984674b48 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.251503 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.252387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.252652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.252932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] PATH_INFO: `/v3/projects/2a16cbc3258c447fbca1777ed01f8b84/users/5740952919c44f739b3217459dfefe54/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.267918 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a16cbc3258c447fbca1777ed01f8b84, user_id=5740952919c44f739b3217459dfefe54, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.271524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.284149 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1336/2697] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:57 2022] PUT /identity/v3/projects/2a16cbc3258c447fbca1777ed01f8b84/users/5740952919c44f739b3217459dfefe54/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:57.288499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.298289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c1957-8bba-45f4-bee2-7af5fba6ccc5 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.352732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c058e04-dc40-4eb7-8334-4e2b405bf9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.353332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c058e04-dc40-4eb7-8334-4e2b405bf9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.353615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c058e04-dc40-4eb7-8334-4e2b405bf9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.353935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c058e04-dc40-4eb7-8334-4e2b405bf9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.354661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c058e04-dc40-4eb7-8334-4e2b405bf9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.356253 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c058e04-dc40-4eb7-8334-4e2b405bf9b2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.365739 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1362/2698] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:57.370078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.380707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ba05-14bd-4f22-bf94-c0ae479e9ea0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.385366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.386262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.386560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.386869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] PATH_INFO: `/v3/projects/2a16cbc3258c447fbca1777ed01f8b84/users/5740952919c44f739b3217459dfefe54/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.389014 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a16cbc3258c447fbca1777ed01f8b84, user_id=5740952919c44f739b3217459dfefe54, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.391632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.402151 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1337/2699] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:57 2022] PUT /identity/v3/projects/2a16cbc3258c447fbca1777ed01f8b84/users/5740952919c44f739b3217459dfefe54/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:57.412122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.412591 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.412701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.439434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] MFA Rules not processed for user `5740952919c44f739b3217459dfefe54`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:57.440631 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:57.507142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1363/2700] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:57.518357 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.520888 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:57.577526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86c7f-2071-43d5-8722-b220a9ff6dc9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.581107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.581762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.582073 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.582353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.591059 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.592466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.601718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1338/2701] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:57.669610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:57.679803 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508492c8-b1e7-4162-a23f-2a86eda5e43c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:57.683436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d255-dd5d-4f1a-bc78-f6575d8d44b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:57.684068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d255-dd5d-4f1a-bc78-f6575d8d44b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:57.684353 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d255-dd5d-4f1a-bc78-f6575d8d44b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:57.684633 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d255-dd5d-4f1a-bc78-f6575d8d44b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:57.739817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0d255-dd5d-4f1a-bc78-f6575d8d44b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:57.741245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0d255-dd5d-4f1a-bc78-f6575d8d44b9 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:57.750195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1364/2702] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:05:58.001645 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:58.062688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fc7c-53de-4d3f-a7a0-7beb58360a02 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:58.067188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:58.068044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:58.068321 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:58.068592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] PATH_INFO: `/v3/users/99a6e8cd3b3c42e984dad1872df9a253` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:58.069755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a6e8cd3b3c42e984dad1872df9a253)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:58.071680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:58.117425 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a6e8cd3b3c42e984dad1872df9a253'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.118060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a6e8cd3b3c42e984dad1872df9a253'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.129955 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a6e8cd3b3c42e984dad1872df9a253'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.136434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a6e8cd3b3c42e984dad1872df9a253'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.137063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a6e8cd3b3c42e984dad1872df9a253'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.149813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1339/2703] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:05:58 2022] DELETE /identity/v3/users/99a6e8cd3b3c42e984dad1872df9a253 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:58.154385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:58.154705 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:58.154986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:58.172595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:58.173818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:58.234925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1365/2704] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:58.245336 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:58.246739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:58.301571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348acd-ebc9-4a86-a0d5-3fed33da833a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:58.305193 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:58.305851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:58.306137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:58.306410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:58.315070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:58.316825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:58.328446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1340/2705] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:05:58.590308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:58.591772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:58.604126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80d19a-44b2-48ed-82aa-c385fee8297c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:58.609360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:58.610284 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:58.610569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:58.610847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] PATH_INFO: `/v3/projects/487ef04ac4d4497c93634e4b397393d6` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:58.612027 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487ef04ac4d4497c93634e4b397393d6)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:58.614539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:58.660748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487ef04ac4d4497c93634e4b397393d6', 'request_id': 'req-b8bec0e1-91ee-4c29-a629-621f9f791b16'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.666686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487ef04ac4d4497c93634e4b397393d6', 'request_id': 'req-b8bec0e1-91ee-4c29-a629-621f9f791b16'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.672095 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487ef04ac4d4497c93634e4b397393d6', 'request_id': 'req-b8bec0e1-91ee-4c29-a629-621f9f791b16'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.684610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] The token cache is being invalidate because project 487ef04ac4d4497c93634e4b397393d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:05:58.684902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.685527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.687076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1366/2706] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:05:58 2022] DELETE /identity/v3/projects/487ef04ac4d4497c93634e4b397393d6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:05:58.691141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:58.700683 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfb23-d079-454a-bfb8-38aefc9ec88d service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:58.755192 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:58.756048 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:58.756329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:58.756598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] PATH_INFO: `/v3/users/5740952919c44f739b3217459dfefe54` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:58.757759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5740952919c44f739b3217459dfefe54)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:58.759675 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:58.805187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5740952919c44f739b3217459dfefe54'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.805856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5740952919c44f739b3217459dfefe54'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.817042 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5740952919c44f739b3217459dfefe54'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.823627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5740952919c44f739b3217459dfefe54'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.824257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7d246a6e-fffe-4fb8-9fb0-3a75b88473d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5740952919c44f739b3217459dfefe54'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:58.836173 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1341/2707] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:05:58 2022] DELETE /identity/v3/users/5740952919c44f739b3217459dfefe54 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:59.105560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.107062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:59.121589 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bec0e1-91ee-4c29-a629-621f9f791b16 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.180735 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.181536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.181844 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.182137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] PATH_INFO: `/v3/projects/2a16cbc3258c447fbca1777ed01f8b84` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.183298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a16cbc3258c447fbca1777ed01f8b84)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.185240 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.230773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a16cbc3258c447fbca1777ed01f8b84', 'request_id': 'req-8e313b72-8fe0-4596-8f8a-c16b51d74878'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:59.237211 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a16cbc3258c447fbca1777ed01f8b84', 'request_id': 'req-8e313b72-8fe0-4596-8f8a-c16b51d74878'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:59.243548 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a16cbc3258c447fbca1777ed01f8b84', 'request_id': 'req-8e313b72-8fe0-4596-8f8a-c16b51d74878'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:59.258694 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] The token cache is being invalidate because project 2a16cbc3258c447fbca1777ed01f8b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:05:59.259013 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:59.259692 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-8e313b72-8fe0-4596-8f8a-c16b51d74878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:05:59.261330 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1367/2708] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:05:59 2022] DELETE /identity/v3/projects/2a16cbc3258c447fbca1777ed01f8b84 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:59.267244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.267540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.267818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.287704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:59.288885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:59.346283 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1342/2709] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:59.354866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.355163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.355503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.374960 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:59.376300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:59.385433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1368/2710] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:59.389646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.400012 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6fadc-9fb0-4388-ba51-c8fe0a9171ac None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.404610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.405288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.405571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.405884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.406614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:05:59.406926 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.408529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.419860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1343/2711] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:05:59.424099 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.433717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bea4-dd3a-4b5c-9025-22cbec1dfc8e None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.438274 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.438923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.439207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.439485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.440169 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.443081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.468948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1369/2712] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:05:59 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:05:59.473490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.483492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661423-bd3e-42c1-be5c-53ac4cb8c4ff admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.537681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.538366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.538643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.538913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.539598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.541490 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.560559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1344/2713] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:05:59 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:05:59.565206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.575227 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62ff3-9df3-4ffc-81bf-52367e00aee6 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.580177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.580950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.581259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.581541 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.582342 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.583994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.594207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1370/2714] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:59.598768 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.608397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fd9fa-40d9-4a2a-b9e9-9b9e15147ee7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.613564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f7b3-2d06-431d-ab4a-f71cfb47bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.614244 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f7b3-2d06-431d-ab4a-f71cfb47bbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.614526 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f7b3-2d06-431d-ab4a-f71cfb47bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.614797 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f7b3-2d06-431d-ab4a-f71cfb47bbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.615517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99f7b3-2d06-431d-ab4a-f71cfb47bbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.617098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99f7b3-2d06-431d-ab4a-f71cfb47bbe8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.626858 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1345/2715] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:05:59.630909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.640471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b69cdf-37b4-4af5-9c7e-990ae7582657 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.644996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.645883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.646166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.646438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] PATH_INFO: `/v3/projects/60991b8b03324bae9940fbc0ff6ca935/users/527b45d3ddb24164bc950b9ef00aea67/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.660953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60991b8b03324bae9940fbc0ff6ca935, user_id=527b45d3ddb24164bc950b9ef00aea67, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.663718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.676785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1371/2716] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:05:59 2022] PUT /identity/v3/projects/60991b8b03324bae9940fbc0ff6ca935/users/527b45d3ddb24164bc950b9ef00aea67/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:05:59.688078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.688317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.688600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.714915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] MFA Rules not processed for user `527b45d3ddb24164bc950b9ef00aea67`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:05:59.716119 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:59.779285 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1346/2717] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:05:59.791186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:05:59.792864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:05:59.869701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb846-6d10-4e72-bb65-cb4d5f9f18b9 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:05:59.873392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5236e-3ee7-4764-b33e-6d6f944630e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd83f55b1a84d1894d19a505bcc18c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:05:59.874055 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5236e-3ee7-4764-b33e-6d6f944630e0 service glance] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:05:59.874341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5236e-3ee7-4764-b33e-6d6f944630e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:05:59.874620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5236e-3ee7-4764-b33e-6d6f944630e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:05:59.882757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5236e-3ee7-4764-b33e-6d6f944630e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:05:59.884176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5236e-3ee7-4764-b33e-6d6f944630e0 service glance] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:05:59.892768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1372/2718] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:05:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:06:16.319578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:16.379284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb32e2-f075-4f66-b8f7-a3fda660c2c1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:16.383761 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:16.384616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:16.384899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:16.385178 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] PATH_INFO: `/v3/users/527b45d3ddb24164bc950b9ef00aea67` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:16.386380 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527b45d3ddb24164bc950b9ef00aea67)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:16.388326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:16.432333 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527b45d3ddb24164bc950b9ef00aea67'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.432974 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527b45d3ddb24164bc950b9ef00aea67'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.444505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527b45d3ddb24164bc950b9ef00aea67'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.451068 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527b45d3ddb24164bc950b9ef00aea67'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.451700 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527b45d3ddb24164bc950b9ef00aea67'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.464317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1347/2719] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:06:16 2022] DELETE /identity/v3/users/527b45d3ddb24164bc950b9ef00aea67 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:16.468771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:16.469191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:16.469360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:16.487315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:16.488542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:16.545924 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1373/2720] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:16.555525 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:16.556925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:16.612118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8a85-083a-4e70-b54b-9209cb851ad3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:16.616064 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c8564-b06b-4a3d-89f0-1352879c32d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:16.616702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c8564-b06b-4a3d-89f0-1352879c32d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:16.616987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c8564-b06b-4a3d-89f0-1352879c32d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:16.617264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c8564-b06b-4a3d-89f0-1352879c32d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:16.626464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c8564-b06b-4a3d-89f0-1352879c32d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:16.627892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c8564-b06b-4a3d-89f0-1352879c32d7 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:16.637659 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1348/2721] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:06:16.891287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:16.892766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:16.907239 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46b451-c081-4414-af52-725b9fdd75bc None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:16.912885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:16.913763 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:16.914074 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:16.914351 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] PATH_INFO: `/v3/projects/60991b8b03324bae9940fbc0ff6ca935` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:16.916146 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=60991b8b03324bae9940fbc0ff6ca935)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:16.919116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:16.965112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60991b8b03324bae9940fbc0ff6ca935', 'request_id': 'req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.971022 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60991b8b03324bae9940fbc0ff6ca935', 'request_id': 'req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.976420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60991b8b03324bae9940fbc0ff6ca935', 'request_id': 'req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.989203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] The token cache is being invalidate because project 60991b8b03324bae9940fbc0ff6ca935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:06:16.989610 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.990271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-7df00a24-9bfa-4443-8ad6-2d5d7e4c94ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:16.991825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1374/2722] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:06:16 2022] DELETE /identity/v3/projects/60991b8b03324bae9940fbc0ff6ca935 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:16.997330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:16.997618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:16.997927 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.015731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:17.016929 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:17.075860 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1349/2723] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:17.083899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.084057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.084338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.102494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:17.103676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:17.111570 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1375/2724] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:17.116422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.126263 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154ad7-1edd-445d-b071-a710d8381e80 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.131706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.132387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.132634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.132912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.133638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:06:17.133995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.135562 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.147329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1350/2725] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:06:17.151491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.161039 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2096d-42c7-43f3-810a-a483ea5873ba None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.165847 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.166499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.166781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.167059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.167752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.169658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.194818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1376/2726] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:06:17.199071 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.209433 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07430704-7191-45ba-97fb-711f18d8c5e3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.263309 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.263978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.264259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.264532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.265215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.267187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.287391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1351/2727] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:06:17.291616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.302026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c98b-37e4-4df1-a7b5-ff8bf92cba99 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.306539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.307195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.307475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.307748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.308466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.310092 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.320124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1377/2728] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:06:17.324002 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.334271 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3441-770f-4936-bc20-675466566612 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.338763 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bf552-8f90-4e29-84cf-7cb8aa520c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.339405 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bf552-8f90-4e29-84cf-7cb8aa520c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.339686 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bf552-8f90-4e29-84cf-7cb8aa520c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.339960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bf552-8f90-4e29-84cf-7cb8aa520c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.340677 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bf552-8f90-4e29-84cf-7cb8aa520c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.342286 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bf552-8f90-4e29-84cf-7cb8aa520c0b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.352416 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1352/2729] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:06:17.356422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.366277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee016-df17-41e3-83fb-fc2a12244973 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.371143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.372011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.372294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.372577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] PATH_INFO: `/v3/projects/9bc01bc521684aa0b37e0cda00aec499/users/91ba3dd4792c4209aaca085c6e6de0ec/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.387323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc01bc521684aa0b37e0cda00aec499, user_id=91ba3dd4792c4209aaca085c6e6de0ec, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.390001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.404023 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1378/2730] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:06:17 2022] PUT /identity/v3/projects/9bc01bc521684aa0b37e0cda00aec499/users/91ba3dd4792c4209aaca085c6e6de0ec/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:17.414557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.415021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.415303 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.442423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] MFA Rules not processed for user `91ba3dd4792c4209aaca085c6e6de0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:17.443750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:17.506237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1353/2731] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:17.510707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.571467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20d02-e786-417d-8d25-6517cedf3ddf admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.576208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.576866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.577145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.577417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.578168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.580045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.604598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1379/2732] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:06:17.608748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.620015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e7a1-3dfe-4678-8e35-0dd648b8d0b1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.675540 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.676200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.676483 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.676757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.677443 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.679391 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.699422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1354/2733] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:06:17.703332 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.713622 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d805-dba6-4ba3-b6b2-a67e8dfdde98 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.718247 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.718905 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.719187 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.719461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.720189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.722320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.732814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1380/2734] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:06:17.736631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.747643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b028e-90af-4676-a514-0e2463fc0792 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.752136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef86a-7974-4ba1-8eb1-dbc832d2a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.752775 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef86a-7974-4ba1-8eb1-dbc832d2a90d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.753069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef86a-7974-4ba1-8eb1-dbc832d2a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.753342 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef86a-7974-4ba1-8eb1-dbc832d2a90d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.754099 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef86a-7974-4ba1-8eb1-dbc832d2a90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.755679 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef86a-7974-4ba1-8eb1-dbc832d2a90d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.765163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1355/2735] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:06:17.769730 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.779339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066221f-dbb2-4020-93fa-e5b89e0c646f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.783872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.785426 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.785703 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.786006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] PATH_INFO: `/v3/projects/7c82b9e457464e829675f7d7ee90f2d2/users/c75ef40aa60f4f4dbf1959438d4a2a37/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.800540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c82b9e457464e829675f7d7ee90f2d2, user_id=c75ef40aa60f4f4dbf1959438d4a2a37, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.803206 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:17.816192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1381/2736] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:06:17 2022] PUT /identity/v3/projects/7c82b9e457464e829675f7d7ee90f2d2/users/c75ef40aa60f4f4dbf1959438d4a2a37/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:17.827231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.827528 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.827820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.855160 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] MFA Rules not processed for user `c75ef40aa60f4f4dbf1959438d4a2a37`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:17.856304 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:17.918772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1356/2737] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:17.923267 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:17.983109 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2746d0b-ee01-4b71-99f0-2854dd2e923c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:17.988254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:17.988934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:17.989221 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:17.989534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:17.990226 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:17.992113 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.016509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1382/2738] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:06:17 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:06:18.021722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:18.032212 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb96d4e-153a-47ac-8557-2189949b7833 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:18.090057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:18.090709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.090987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.091261 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.091938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:18.093850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.120458 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1357/2739] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:06:18 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:06:18.124762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:18.135948 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6bae5-5053-44b9-9090-f3f360ea3d47 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:18.140542 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:18.141447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.141447 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.141738 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.142479 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:18.144755 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.154996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1383/2740] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:06:18.159135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:18.169032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c56164-b6de-4621-9212-1e3bcfa4c727 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:18.173741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:18.174643 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.175302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.175548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] PATH_INFO: `/v3/projects/47098ff0a30c4515a949d283911a316e/users/5bd97c427b95476b948e9139052c52cd/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.189852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47098ff0a30c4515a949d283911a316e, user_id=5bd97c427b95476b948e9139052c52cd, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:18.192975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.206947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1358/2741] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:06:18 2022] PUT /identity/v3/projects/47098ff0a30c4515a949d283911a316e/users/5bd97c427b95476b948e9139052c52cd/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:18.211126 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:18.221163 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1a968-5543-40d2-9ad2-4ee77d5d3918 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:18.276183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c4987-cff7-47da-9315-ddc419e67fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:18.276850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c4987-cff7-47da-9315-ddc419e67fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.277131 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c4987-cff7-47da-9315-ddc419e67fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.277409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c4987-cff7-47da-9315-ddc419e67fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.278186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c4987-cff7-47da-9315-ddc419e67fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:18.279781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c4987-cff7-47da-9315-ddc419e67fc2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.289102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1384/2742] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:06:18.293331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:18.303247 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848471ac-a5d1-45de-973c-9902f9e4ad3a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:18.307745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:18.308605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.308900 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.309171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] PATH_INFO: `/v3/projects/47098ff0a30c4515a949d283911a316e/users/5bd97c427b95476b948e9139052c52cd/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.311129 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47098ff0a30c4515a949d283911a316e, user_id=5bd97c427b95476b948e9139052c52cd, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:18.313724 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.324164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1359/2743] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:06:18 2022] PUT /identity/v3/projects/47098ff0a30c4515a949d283911a316e/users/5bd97c427b95476b948e9139052c52cd/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:06:18.334875 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.335191 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.335488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.360207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] MFA Rules not processed for user `5bd97c427b95476b948e9139052c52cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:18.361324 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:18.441427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1385/2744] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:18.452981 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:18.454722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:18.511313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd52892-965f-4576-b8c5-8b4823f9dad4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:18.514897 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:18.515567 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:18.515850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:18.516122 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:18.569962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:18.571392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:18.580057 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1360/2745] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:06:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:06:20.045443 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:20.055174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2703f-5cd5-45bd-8e36-b16456559c32 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:20.058862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:20.059527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:20.059810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:20.060087 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:20.114838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:20.116299 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:20.125370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1386/2746] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:06:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:06:20.629662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:20.638081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc897b-6dfb-48f3-89b6-fbb8a94e0286 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:20.641650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821b63c-dd89-45d1-8d7a-9f01f63072e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:20.642308 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b63c-dd89-45d1-8d7a-9f01f63072e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:20.642589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b63c-dd89-45d1-8d7a-9f01f63072e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:20.642864 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b63c-dd89-45d1-8d7a-9f01f63072e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:20.653805 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821b63c-dd89-45d1-8d7a-9f01f63072e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:20.655259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821b63c-dd89-45d1-8d7a-9f01f63072e4 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:20.665238 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1361/2747] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:06:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:06:24.467536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:24.529728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b338c-b774-4c49-9b77-cf6eb30cbf11 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:24.534241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:24.535801 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:24.536081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:24.536357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] PATH_INFO: `/v3/users/91ba3dd4792c4209aaca085c6e6de0ec` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:24.537529 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ba3dd4792c4209aaca085c6e6de0ec)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:24.539459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:24.584771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ba3dd4792c4209aaca085c6e6de0ec'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:24.585430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ba3dd4792c4209aaca085c6e6de0ec'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:24.596712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ba3dd4792c4209aaca085c6e6de0ec'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:24.604017 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ba3dd4792c4209aaca085c6e6de0ec'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:24.604681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ba3dd4792c4209aaca085c6e6de0ec'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:24.621879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1387/2748] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:06:24 2022] DELETE /identity/v3/users/91ba3dd4792c4209aaca085c6e6de0ec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:24.626287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:24.626731 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:24.626837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:24.644702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:06:24.646110 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:24.700914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1362/2749] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:06:24.711084 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:24.712575 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:24.767696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820b31-2521-42b8-9366-63f0067f8cad admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:24.771868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:24.772505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:24.772785 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:24.773060 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:24.781834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:24.783241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:24.793026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1388/2750] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:06:25.050124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:25.051913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:25.063811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78b03d-5c63-4c59-86f0-8f2b95020398 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:25.069393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:25.070323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:25.070611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:25.070889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] PATH_INFO: `/v3/projects/9bc01bc521684aa0b37e0cda00aec499` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:25.072318 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc01bc521684aa0b37e0cda00aec499)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:25.075053 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:25.121903 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc01bc521684aa0b37e0cda00aec499', 'request_id': 'req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.127767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc01bc521684aa0b37e0cda00aec499', 'request_id': 'req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.133577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc01bc521684aa0b37e0cda00aec499', 'request_id': 'req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.145699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] The token cache is being invalidate because project 9bc01bc521684aa0b37e0cda00aec499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:06:25.146006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.146614 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.148159 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1363/2751] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:06:25 2022] DELETE /identity/v3/projects/9bc01bc521684aa0b37e0cda00aec499 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:25.152181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:25.162136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d3eb4-139e-4255-9514-3ac6a2930f96 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:25.217131 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:25.218041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:25.218321 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:25.218590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] PATH_INFO: `/v3/users/c75ef40aa60f4f4dbf1959438d4a2a37` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:25.219764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75ef40aa60f4f4dbf1959438d4a2a37)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:25.221700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:25.264874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75ef40aa60f4f4dbf1959438d4a2a37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.265442 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75ef40aa60f4f4dbf1959438d4a2a37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.276565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75ef40aa60f4f4dbf1959438d4a2a37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.282998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75ef40aa60f4f4dbf1959438d4a2a37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.283616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75ef40aa60f4f4dbf1959438d4a2a37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.295537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1389/2752] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:06:25 2022] DELETE /identity/v3/users/c75ef40aa60f4f4dbf1959438d4a2a37 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:25.557550 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:25.559087 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:25.573020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bb6c0-4907-41ac-a9e5-d74a6cb09d3f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:25.631300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:25.632163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:25.632450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:25.632728 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] PATH_INFO: `/v3/projects/7c82b9e457464e829675f7d7ee90f2d2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:25.633938 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c82b9e457464e829675f7d7ee90f2d2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:25.635892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:25.682813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c82b9e457464e829675f7d7ee90f2d2', 'request_id': 'req-728a72e2-5e62-4a74-b861-64dfe177a7b0'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.688640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c82b9e457464e829675f7d7ee90f2d2', 'request_id': 'req-728a72e2-5e62-4a74-b861-64dfe177a7b0'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.694384 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c82b9e457464e829675f7d7ee90f2d2', 'request_id': 'req-728a72e2-5e62-4a74-b861-64dfe177a7b0'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.706322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] The token cache is being invalidate because project 7c82b9e457464e829675f7d7ee90f2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:06:25.707179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.708249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.709809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1364/2753] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:06:25 2022] DELETE /identity/v3/projects/7c82b9e457464e829675f7d7ee90f2d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:25.713850 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:25.715424 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:25.728098 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38de3-33ea-4981-a4a9-aef5e83bff30 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:25.782199 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:25.783068 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:25.783348 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:25.783624 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] PATH_INFO: `/v3/users/5bd97c427b95476b948e9139052c52cd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:25.784864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd97c427b95476b948e9139052c52cd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:25.786827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:25.830496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd97c427b95476b948e9139052c52cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.831153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd97c427b95476b948e9139052c52cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.842953 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd97c427b95476b948e9139052c52cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.849488 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd97c427b95476b948e9139052c52cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.850192 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd97c427b95476b948e9139052c52cd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:25.863033 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1390/2754] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:06:25 2022] DELETE /identity/v3/users/5bd97c427b95476b948e9139052c52cd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:26.127044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:26.128557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:26.141095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a72e2-5e62-4a74-b861-64dfe177a7b0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:26.197082 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:26.197970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:26.198262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:26.198538 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] PATH_INFO: `/v3/projects/47098ff0a30c4515a949d283911a316e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:26.199703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=47098ff0a30c4515a949d283911a316e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:26.201589 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:26.245830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47098ff0a30c4515a949d283911a316e', 'request_id': 'req-c79d876a-26b8-4616-af49-306e4d5613ee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:26.251611 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47098ff0a30c4515a949d283911a316e', 'request_id': 'req-c79d876a-26b8-4616-af49-306e4d5613ee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:26.256928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47098ff0a30c4515a949d283911a316e', 'request_id': 'req-c79d876a-26b8-4616-af49-306e4d5613ee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:26.270366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] The token cache is being invalidate because project 47098ff0a30c4515a949d283911a316e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:06:26.270651 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:26.271295 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:06:26.272836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1365/2755] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:06:26 2022] DELETE /identity/v3/projects/47098ff0a30c4515a949d283911a316e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:06:39.513165 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:06:39.514579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:39.580842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577842a9-e304-4bc9-9eac-584f8d35019b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:06:39.638781 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:06:39.639427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:06:39.639709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:06:39.639987 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:06:39.641761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:06:39.652725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:06:39.654341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:06:39.664035 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1391/2756] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:06:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:08:22.325814 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:08:22.327189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:08:22.382056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d876a-26b8-4616-af49-306e4d5613ee admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:08:22.385577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:08:22.386248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:08:22.386530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:08:22.386808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:08:22.388527 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:08:22.464593 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:08:22.466074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:08:22.484438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1366/2757] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:08:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:11:46.529616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:11:46.531106 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:11:46.612961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d8db-abe8-4c67-a1ab-34696ef418c3 service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:11:46.619015 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:11:46.619658 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:11:46.619944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:11:46.620224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:11:46.628902 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:11:46.630505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:11:46.640427 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1392/2758] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:11:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:21.298767 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:21.300153 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:21.376217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa142-ce14-43d6-b1cd-51926233046e service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:21.380093 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:21.380723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:21.381006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:21.381284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:21.383028 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:21.462560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:21.463874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:21.482915 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1367/2759] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:24.780234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:24.781678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:24.798522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd749-5378-43f6-a297-eb5dfabd5fda service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:24.802983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:24.803842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:24.804121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:24.804392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] PATH_INFO: `/v3/users/146368a389f94e2fbe6776bb27d60378` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:24.805546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146368a389f94e2fbe6776bb27d60378)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:24.808090 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:24.852128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146368a389f94e2fbe6776bb27d60378'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:24.852771 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146368a389f94e2fbe6776bb27d60378'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:24.864368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146368a389f94e2fbe6776bb27d60378'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:24.871890 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146368a389f94e2fbe6776bb27d60378'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:24.872553 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fffcc32c-91b9-4375-a3af-d158ef2f3254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146368a389f94e2fbe6776bb27d60378'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:24.885598 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1393/2760] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:24 2022] DELETE /identity/v3/users/146368a389f94e2fbe6776bb27d60378 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:25.054571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.066627 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fbdca-1475-4c14-b8a7-5123d43f721b service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.122257 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.123107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.123381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.123647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] PATH_INFO: `/v3/projects/13b282e27b404c7dbefc9de2ea947595` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.124809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b282e27b404c7dbefc9de2ea947595)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.126722 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.171975 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b282e27b404c7dbefc9de2ea947595', 'request_id': 'req-79cfeec7-5bd9-48a0-adf1-a081f67482c0'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:25.177808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b282e27b404c7dbefc9de2ea947595', 'request_id': 'req-79cfeec7-5bd9-48a0-adf1-a081f67482c0'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:25.183236 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b282e27b404c7dbefc9de2ea947595', 'request_id': 'req-79cfeec7-5bd9-48a0-adf1-a081f67482c0'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:25.194806 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] The token cache is being invalidate because project 13b282e27b404c7dbefc9de2ea947595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:25.195097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:25.195715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-79cfeec7-5bd9-48a0-adf1-a081f67482c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:25.197353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1368/2761] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:25 2022] DELETE /identity/v3/projects/13b282e27b404c7dbefc9de2ea947595 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:25.203043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.203334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.203618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.258657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:25.259864 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:25.316797 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1394/2762] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:25.324682 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.324990 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.325259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.343950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:25.345143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:25.352863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1369/2763] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:25.358040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.367534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fbce-bbc4-4119-8e4f-b968ad1a3af5 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.372287 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.372937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.373223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.373503 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.374273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:25.374587 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.376186 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.388368 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1395/2764] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:12:25.392522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.402466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d6d52-840f-4688-ad11-0a133e7fdd47 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.407103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.407749 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.408033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.408337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.409029 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.410963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.445912 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1370/2765] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:25 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:25.450670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.460382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8288b79-5d7d-4918-a292-0d24a449514d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.519377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.520052 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.520339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.520617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.521314 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.523254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.543156 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1396/2766] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:25 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:25.547180 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.557738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154683-3a46-4eed-9f31-c342643c17fd admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.562329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.562995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.563259 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.563537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.564277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.565874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.576601 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1371/2767] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:25.580217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.590725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e37c-0192-46c6-a288-75dc47bdeee8 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.595249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674dae-2125-4b52-8cee-85370926b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.595923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674dae-2125-4b52-8cee-85370926b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.596200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674dae-2125-4b52-8cee-85370926b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.596472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674dae-2125-4b52-8cee-85370926b6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.597216 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674dae-2125-4b52-8cee-85370926b6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.598852 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674dae-2125-4b52-8cee-85370926b6d0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.608417 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1397/2768] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:25.612264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.622088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f14670-bfed-4ff6-897d-b701eeb6a3c0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.626723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.627582 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.627867 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.628407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] PATH_INFO: `/v3/projects/308142685e2f4654b855529ee543d5e0/users/b70e0acb38cc4edfb2fedb75c2cc43fa/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.643636 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308142685e2f4654b855529ee543d5e0, user_id=b70e0acb38cc4edfb2fedb75c2cc43fa, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.646275 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.659253 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1372/2769] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:25 2022] PUT /identity/v3/projects/308142685e2f4654b855529ee543d5e0/users/b70e0acb38cc4edfb2fedb75c2cc43fa/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:25.670089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.670491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.670775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.695970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] MFA Rules not processed for user `b70e0acb38cc4edfb2fedb75c2cc43fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:25.697807 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:25.761044 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1398/2770] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:25.771672 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:25.773334 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:25.837289 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb469cb-4a02-4eb2-a992-f061dc201ee9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:25.841147 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:25.841778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:25.842084 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:25.842376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:25.850434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:25.851837 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:25.860511 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1373/2771] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:27.209122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:27.210514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:27.222726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a013-712e-4078-b490-1d78c77a233d None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:27.226244 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:27.226878 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:27.227159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:27.227433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:27.229296 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:27.314153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:27.315580 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:27.335856 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1399/2772] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:28.703547 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:28.712022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09949c2-c71c-4a20-af74-a95b29821b83 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:28.716270 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:28.716894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:28.717175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:28.717450 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:28.719239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:28.733232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:28.734690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ce75f-f968-42e1-bdf0-0cbe6517502a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:28.745748 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1374/2773] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:34.252611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:34.314178 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc18dbf-2568-4e14-b37c-aebf300b4830 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:34.318704 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:34.319578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:34.319860 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:34.320137 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] PATH_INFO: `/v3/users/b70e0acb38cc4edfb2fedb75c2cc43fa` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:34.321310 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70e0acb38cc4edfb2fedb75c2cc43fa)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:34.323265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:34.499112 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70e0acb38cc4edfb2fedb75c2cc43fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:34.499693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70e0acb38cc4edfb2fedb75c2cc43fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:34.511168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70e0acb38cc4edfb2fedb75c2cc43fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:34.518195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70e0acb38cc4edfb2fedb75c2cc43fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:34.518819 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70e0acb38cc4edfb2fedb75c2cc43fa'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:34.531709 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1400/2774] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:34 2022] DELETE /identity/v3/users/b70e0acb38cc4edfb2fedb75c2cc43fa => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:34.536313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:34.536786 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:34.536889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:34.553946 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:34.555104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:34.610878 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1375/2775] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:34.620372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:34.621986 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:34.676762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c919b7-10a0-45ec-a1d5-680e3ce14793 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:34.680357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b96d96-07a4-463f-b849-b8a7f7736c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:34.680990 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96d96-07a4-463f-b849-b8a7f7736c5a service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:34.681269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96d96-07a4-463f-b849-b8a7f7736c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:34.681543 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96d96-07a4-463f-b849-b8a7f7736c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:34.690363 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b96d96-07a4-463f-b849-b8a7f7736c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:34.691765 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b96d96-07a4-463f-b849-b8a7f7736c5a service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:34.701504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1401/2776] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:34.959164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:34.960581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:34.972615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367e1fb-8de6-4c32-8690-703ea2adc425 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:34.977146 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:34.978033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:34.978313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:34.978585 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] PATH_INFO: `/v3/projects/308142685e2f4654b855529ee543d5e0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:34.979754 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308142685e2f4654b855529ee543d5e0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:34.982197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.027704 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308142685e2f4654b855529ee543d5e0', 'request_id': 'req-36a583d5-c1fc-48e6-9079-80d6cba02d42'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:35.033750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308142685e2f4654b855529ee543d5e0', 'request_id': 'req-36a583d5-c1fc-48e6-9079-80d6cba02d42'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:35.038947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308142685e2f4654b855529ee543d5e0', 'request_id': 'req-36a583d5-c1fc-48e6-9079-80d6cba02d42'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:35.051125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] The token cache is being invalidate because project 308142685e2f4654b855529ee543d5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:35.051322 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:35.051935 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-36a583d5-c1fc-48e6-9079-80d6cba02d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:35.053462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1376/2777] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:34 2022] DELETE /identity/v3/projects/308142685e2f4654b855529ee543d5e0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:35.058357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.058672 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.058946 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.076657 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:35.077845 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:35.133188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1402/2778] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:35.140892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.141183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.141465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.159781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:35.160962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:35.168813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1377/2779] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:35.173585 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.182779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302cbca-8fbf-428d-b74a-acce3d61a459 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.187306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.187943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.188218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.188487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.189208 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:35.189507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.191110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.202180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1403/2780] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:12:35.206200 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.215242 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fae55e-39ee-4aa9-9795-f3761241f7c7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.220516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.221165 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.221447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.221720 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.222457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.224343 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.249486 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1378/2781] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:35 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:35.253469 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.263818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798852b3-f9ba-465a-9e17-789213f1d641 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.318734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.319395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.319679 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.319966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.320655 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.322576 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.343429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1404/2782] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:35 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:35.347662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.358207 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f2c8-eb34-48d0-9599-d92647d69b2c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.362836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.363485 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.363766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.364041 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.364809 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.366437 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.377272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1379/2783] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:35.381377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.392150 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cacf8-6027-40ab-af80-bfecffd23ae4 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.396722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed30053-f23a-4a79-b1df-776f23724956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.397370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed30053-f23a-4a79-b1df-776f23724956 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.397654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed30053-f23a-4a79-b1df-776f23724956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.397961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed30053-f23a-4a79-b1df-776f23724956 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.398686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed30053-f23a-4a79-b1df-776f23724956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.400257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed30053-f23a-4a79-b1df-776f23724956 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.410436 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1405/2784] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:35.414397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.425118 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2c687-661d-45d9-87f7-b8f0d92bcdde admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.429821 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.430685 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.430969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.431245 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] PATH_INFO: `/v3/projects/186307c94f4e4086bc609ca788cd56f1/users/ee560b57d69640d7a72538bdb826ed14/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.445823 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=186307c94f4e4086bc609ca788cd56f1, user_id=ee560b57d69640d7a72538bdb826ed14, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.448414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.460646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1380/2785] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:35 2022] PUT /identity/v3/projects/186307c94f4e4086bc609ca788cd56f1/users/ee560b57d69640d7a72538bdb826ed14/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:35.471063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.471356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.471665 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.497979 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] MFA Rules not processed for user `ee560b57d69640d7a72538bdb826ed14`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:35.499195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:35.561034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1406/2786] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:35.571999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.573605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:35.644075 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517348de-3c56-493f-9f27-0a69ca5c87cf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.649590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d02e2-dfc1-451f-a429-fcdcc63d7b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.650269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d02e2-dfc1-451f-a429-fcdcc63d7b91 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.650555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d02e2-dfc1-451f-a429-fcdcc63d7b91 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.650833 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d02e2-dfc1-451f-a429-fcdcc63d7b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.658569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d02e2-dfc1-451f-a429-fcdcc63d7b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.660241 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d02e2-dfc1-451f-a429-fcdcc63d7b91 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.668813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1381/2787] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:35.875812 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:35.935957 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def73cff-0f44-4557-b780-dcc4f2af875a None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:35.940626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:35.941495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:35.941762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:35.942070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] PATH_INFO: `/v3/users/ee560b57d69640d7a72538bdb826ed14` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:35.943257 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee560b57d69640d7a72538bdb826ed14)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:35.945159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:35.992141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee560b57d69640d7a72538bdb826ed14'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:35.992788 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee560b57d69640d7a72538bdb826ed14'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.005751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee560b57d69640d7a72538bdb826ed14'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.012477 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee560b57d69640d7a72538bdb826ed14'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.014189 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee560b57d69640d7a72538bdb826ed14'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.026536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1407/2788] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:35 2022] DELETE /identity/v3/users/ee560b57d69640d7a72538bdb826ed14 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:36.031554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.031846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.032124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.049741 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:36.050960 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:36.108056 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1382/2789] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:12:36.117545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.118962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:36.176328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0118-e0df-46eb-9a3e-fcd99f39bc06 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.179973 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84e41-7f0b-49bd-bf22-6cfe369aace1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.180613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84e41-7f0b-49bd-bf22-6cfe369aace1 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.180895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84e41-7f0b-49bd-bf22-6cfe369aace1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.181171 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84e41-7f0b-49bd-bf22-6cfe369aace1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.190719 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba84e41-7f0b-49bd-bf22-6cfe369aace1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.192174 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba84e41-7f0b-49bd-bf22-6cfe369aace1 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.201593 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1408/2790] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:36.461738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.463311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:36.475801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a892-af8c-4396-b4f6-d83f56f83d92 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.481349 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.482495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.482787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.483069 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] PATH_INFO: `/v3/projects/186307c94f4e4086bc609ca788cd56f1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.484435 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186307c94f4e4086bc609ca788cd56f1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.486345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.532280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186307c94f4e4086bc609ca788cd56f1', 'request_id': 'req-5687d101-7c75-43f4-aa3c-7b8ebc293806'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.538136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186307c94f4e4086bc609ca788cd56f1', 'request_id': 'req-5687d101-7c75-43f4-aa3c-7b8ebc293806'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.543454 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186307c94f4e4086bc609ca788cd56f1', 'request_id': 'req-5687d101-7c75-43f4-aa3c-7b8ebc293806'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.554668 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] The token cache is being invalidate because project 186307c94f4e4086bc609ca788cd56f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:36.554954 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.555563 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5687d101-7c75-43f4-aa3c-7b8ebc293806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:36.557089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1383/2791] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:36 2022] DELETE /identity/v3/projects/186307c94f4e4086bc609ca788cd56f1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:36.562617 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.563073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.563180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.580278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:36.581444 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:36.637058 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1409/2792] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:36.645892 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.646404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.646497 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.664694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:36.665932 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:36.674600 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1384/2793] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:36.678662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.688261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab952d6-1c84-448a-8a74-f604cfa5369c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.692775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.693418 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.693702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.694010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.694732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:36.695041 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.696621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.707871 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1410/2794] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:12:36.711901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.721439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d6bd-af3e-42df-829b-a511fdccbe30 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.726011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.726649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.726928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.727199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.727914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.729820 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.755282 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1385/2795] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:36 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:36.759272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.769431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17e4f-53f5-44ea-bc53-91adb7fb56c0 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.823504 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.824161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.824446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.824744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.825962 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.827861 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.848428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1411/2796] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:36 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:36.852439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.862962 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20d1c-84a8-4cc7-97e8-34a13453b7e4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.867496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.868139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.868417 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.868690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.869409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.871024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.881168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1386/2797] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:36.885010 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.894734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5d9d-cee3-4cbf-b7f9-74821d7d525b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.899217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fbb31-5478-4b1f-8e9d-035743cfedab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.899862 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fbb31-5478-4b1f-8e9d-035743cfedab admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.900145 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fbb31-5478-4b1f-8e9d-035743cfedab admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.900422 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fbb31-5478-4b1f-8e9d-035743cfedab admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.901141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fbb31-5478-4b1f-8e9d-035743cfedab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.902756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fbb31-5478-4b1f-8e9d-035743cfedab admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.912879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1412/2798] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:36.916895 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:36.927347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1f6e-1225-4bb7-9c3d-3d0ea5312a63 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:36.931945 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:36.932795 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.933078 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.933354 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] PATH_INFO: `/v3/projects/05cfbe1b57d74076a3631c9ece3c7020/users/6b6fbed61a614c63b3b5ec427e5a407f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:36.948081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cfbe1b57d74076a3631c9ece3c7020, user_id=6b6fbed61a614c63b3b5ec427e5a407f, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:36.951397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:36.963218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1387/2799] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:36 2022] PUT /identity/v3/projects/05cfbe1b57d74076a3631c9ece3c7020/users/6b6fbed61a614c63b3b5ec427e5a407f/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:36.974210 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:36.974505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:36.974790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.000182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] MFA Rules not processed for user `6b6fbed61a614c63b3b5ec427e5a407f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:37.001408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:37.063666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1413/2800] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:37.068274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.129262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f43bb-c01e-432e-8941-7288e4389dc2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.133928 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.134579 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.134863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.135140 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.135824 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.138370 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.162616 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1388/2801] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:37 2022] POST /identity/v3/projects => generated 361 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:37.166472 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.179581 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b6a5-9e36-4bdb-9440-91cb0cf83859 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.242380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.243057 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.243333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.243604 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.244478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.246484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.270375 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1414/2802] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:37 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:37.278097 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.290404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b812db0-4397-4814-ad06-2aab105c3fd8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.296745 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.297414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.297695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.298000 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.298736 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.300369 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.311819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1389/2803] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:37.316168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.326713 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a085fc-daae-42b7-8420-f75fbea6c215 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.331298 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.332176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.332452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.332722 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] PATH_INFO: `/v3/projects/ff034e088f1044cfa8f0323231c21ffb/users/2303895d9c8740d9a4fdacead89bf437/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.348408 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff034e088f1044cfa8f0323231c21ffb, user_id=2303895d9c8740d9a4fdacead89bf437, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.351467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.365431 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1415/2804] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:37 2022] PUT /identity/v3/projects/ff034e088f1044cfa8f0323231c21ffb/users/2303895d9c8740d9a4fdacead89bf437/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:37.369393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.380440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592199e-233d-4429-8269-340b5282cd24 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.436524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9a408-ac28-44db-9eae-1cf9f5dbe82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.437090 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a408-ac28-44db-9eae-1cf9f5dbe82b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.437462 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a408-ac28-44db-9eae-1cf9f5dbe82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.437740 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a408-ac28-44db-9eae-1cf9f5dbe82b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.438496 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9a408-ac28-44db-9eae-1cf9f5dbe82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.440446 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9a408-ac28-44db-9eae-1cf9f5dbe82b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.451387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1390/2805] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:37.456082 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.470016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40efd04-c604-4bce-9a1a-b78819913140 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.477034 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.478527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.479009 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.479468 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] PATH_INFO: `/v3/projects/ff034e088f1044cfa8f0323231c21ffb/users/2303895d9c8740d9a4fdacead89bf437/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.482668 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff034e088f1044cfa8f0323231c21ffb, user_id=2303895d9c8740d9a4fdacead89bf437, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.485297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.499772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1416/2806] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:37 2022] PUT /identity/v3/projects/ff034e088f1044cfa8f0323231c21ffb/users/2303895d9c8740d9a4fdacead89bf437/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:37.510894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.511186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.511482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.539191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] MFA Rules not processed for user `2303895d9c8740d9a4fdacead89bf437`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:37.540388 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:37.619392 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1391/2807] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:37 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:37.634245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:37.636841 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:37.712621 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965737c-6b0a-4d6e-a826-f4325b971d08 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:37.721425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f687a75-7a58-4bca-8a2a-61401e36482b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:37.722105 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f687a75-7a58-4bca-8a2a-61401e36482b service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:37.722385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f687a75-7a58-4bca-8a2a-61401e36482b service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:37.722654 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f687a75-7a58-4bca-8a2a-61401e36482b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:37.734613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f687a75-7a58-4bca-8a2a-61401e36482b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:37.735944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f687a75-7a58-4bca-8a2a-61401e36482b service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:37.746614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1417/2808] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:37 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:38.330403 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:38.389836 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a1acb-47e1-4533-a4a1-524175682e29 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:38.394320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:38.395175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:38.395457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:38.395744 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] PATH_INFO: `/v3/users/6b6fbed61a614c63b3b5ec427e5a407f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:38.396908 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6fbed61a614c63b3b5ec427e5a407f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:38.398859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:38.442710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6fbed61a614c63b3b5ec427e5a407f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.443351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6fbed61a614c63b3b5ec427e5a407f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.455311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6fbed61a614c63b3b5ec427e5a407f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.461859 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6fbed61a614c63b3b5ec427e5a407f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.462584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6fbed61a614c63b3b5ec427e5a407f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.475619 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1392/2809] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:38 2022] DELETE /identity/v3/users/6b6fbed61a614c63b3b5ec427e5a407f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:38.480204 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:38.480496 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:38.480790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:38.497516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:38.498725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:38.554745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1418/2810] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:38.564516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:38.565944 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:38.621453 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850ad96-ffac-4e52-bc57-a8fc70141076 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:38.625195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:38.625852 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:38.626141 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:38.626418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:38.635431 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:38.636856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:38.646535 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1393/2811] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:38.902950 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:38.904545 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:38.916136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d435-f72e-4303-bb03-1fb0b423006c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:38.920874 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:38.921818 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:38.922196 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:38.922538 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] PATH_INFO: `/v3/projects/05cfbe1b57d74076a3631c9ece3c7020` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:38.923800 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cfbe1b57d74076a3631c9ece3c7020)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:38.925686 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:38.970751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cfbe1b57d74076a3631c9ece3c7020', 'request_id': 'req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.976536 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cfbe1b57d74076a3631c9ece3c7020', 'request_id': 'req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.981872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cfbe1b57d74076a3631c9ece3c7020', 'request_id': 'req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.995250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] The token cache is being invalidate because project 05cfbe1b57d74076a3631c9ece3c7020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:38.995506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.996115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:38.998181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1419/2812] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:38 2022] DELETE /identity/v3/projects/05cfbe1b57d74076a3631c9ece3c7020 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:39.002345 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.012164 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ff96-7e6a-41c9-b569-cd90b0263e2d service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.068389 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.069250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.069532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.069830 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] PATH_INFO: `/v3/users/2303895d9c8740d9a4fdacead89bf437` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.071013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2303895d9c8740d9a4fdacead89bf437)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.072934 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.116758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2303895d9c8740d9a4fdacead89bf437'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.117404 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2303895d9c8740d9a4fdacead89bf437'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.129537 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2303895d9c8740d9a4fdacead89bf437'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.136046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2303895d9c8740d9a4fdacead89bf437'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.136681 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ceac2c75-4155-4416-920d-6716414bff63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2303895d9c8740d9a4fdacead89bf437'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.150834 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1394/2813] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:39 2022] DELETE /identity/v3/users/2303895d9c8740d9a4fdacead89bf437 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:39.409684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.411233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:39.425075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89d6e-0240-42fa-ae77-cbeb85b7f7ab admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.480678 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.482102 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.482381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.482661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] PATH_INFO: `/v3/projects/ff034e088f1044cfa8f0323231c21ffb` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.483849 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff034e088f1044cfa8f0323231c21ffb)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.485732 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.529838 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff034e088f1044cfa8f0323231c21ffb', 'request_id': 'req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.535537 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff034e088f1044cfa8f0323231c21ffb', 'request_id': 'req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.540964 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff034e088f1044cfa8f0323231c21ffb', 'request_id': 'req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.552507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] The token cache is being invalidate because project ff034e088f1044cfa8f0323231c21ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:39.552798 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.553397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-859cac73-1a8d-4e06-b86c-7bae9b14ebf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:39.554927 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1420/2814] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:39 2022] DELETE /identity/v3/projects/ff034e088f1044cfa8f0323231c21ffb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:39.560899 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.561386 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.561489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.579898 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:39.581743 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:39.637194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1395/2815] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:12:39.689994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.690280 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.690560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.709005 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:39.710234 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:39.718021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1421/2816] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:39.722335 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.731798 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8eda-d240-4767-8d32-5ff2b57d33f1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.736409 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.737046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.737324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.737598 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.738373 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:39.738680 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.740280 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.752463 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1396/2817] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:12:39.757232 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.767161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f416bd5-9fe3-4426-827d-8ca938d2923b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.771696 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.772345 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.772626 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.772901 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.773588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.775528 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.800118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1422/2818] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:39 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:39.804353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.814584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7751-d3b8-490b-b143-deda46902201 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.868148 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.868804 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.869083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.869353 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.870065 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.871939 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.891769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1397/2819] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:39 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:39.895961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.906016 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5dfc1-e62b-4e66-aa50-2d2296c7bb0c admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.910515 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.911166 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.911445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.911717 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.912430 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.914051 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.924565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1423/2820] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:39.928465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.938774 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a51af8-f611-41c0-8621-434c17a0f6d9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.943541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f33e3-b93e-41eb-b16a-0ea802426af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.944187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f33e3-b93e-41eb-b16a-0ea802426af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.944466 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f33e3-b93e-41eb-b16a-0ea802426af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.944883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f33e3-b93e-41eb-b16a-0ea802426af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.945610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f33e3-b93e-41eb-b16a-0ea802426af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.947226 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f33e3-b93e-41eb-b16a-0ea802426af8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:39.957329 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1398/2821] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:39.961613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:39.971757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e1007-60a9-4178-990d-d797eea07f8f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:39.976278 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:39.977152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:39.977429 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:39.977701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] PATH_INFO: `/v3/projects/0d063aa51e3045b398a1b68a7709940f/users/87234d764b224e318d8460dd6fe0cea8/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:39.992297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d063aa51e3045b398a1b68a7709940f, user_id=87234d764b224e318d8460dd6fe0cea8, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:39.994935 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.009398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1424/2822] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:39 2022] PUT /identity/v3/projects/0d063aa51e3045b398a1b68a7709940f/users/87234d764b224e318d8460dd6fe0cea8/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:40.019472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.019762 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.020039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.046204 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] MFA Rules not processed for user `87234d764b224e318d8460dd6fe0cea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:40.047379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:40.109673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1399/2823] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:40.114245 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.173923 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eec5c7-a5ab-441e-a2c0-fff4390838c7 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.178554 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.179205 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.179490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.179767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.180461 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.182371 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.207306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1425/2824] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:40 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:40.211320 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.222199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbba105-78bc-42e0-afc2-312b91a60227 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.276366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.277022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.277300 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.277573 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.278288 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.280759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.300813 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1400/2825] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:40 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:40.304395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.314478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b7c1-7664-4ab4-b345-288fdc2c1fb2 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.319001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.320021 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.320305 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.320582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.321307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.322925 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.333045 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1426/2826] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:40.337001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.347482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906e002-26aa-4fb3-888b-41a3c4725cb3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.352050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.352911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.353194 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.353471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] PATH_INFO: `/v3/projects/05d691447d41407d88a45de3fa6f9a2d/users/2a74d2c64e94438dabe14ba65c21d35e/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.368326 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d691447d41407d88a45de3fa6f9a2d, user_id=2a74d2c64e94438dabe14ba65c21d35e, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.370951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.383439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1401/2827] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:40 2022] PUT /identity/v3/projects/05d691447d41407d88a45de3fa6f9a2d/users/2a74d2c64e94438dabe14ba65c21d35e/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:40.387225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.396653 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e832f92-fc8e-4fdd-9333-a9e9a97cc7ed admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.450271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ca489-5f53-456b-b872-d868a3e26be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.450975 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ca489-5f53-456b-b872-d868a3e26be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.451400 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ca489-5f53-456b-b872-d868a3e26be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.451693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ca489-5f53-456b-b872-d868a3e26be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.452420 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ca489-5f53-456b-b872-d868a3e26be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.454070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ca489-5f53-456b-b872-d868a3e26be0 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.463772 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1427/2828] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:40.468699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.479091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8255-ec7b-470b-b094-811a11a52cd3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.484880 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.485845 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.486135 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.486412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] PATH_INFO: `/v3/projects/05d691447d41407d88a45de3fa6f9a2d/users/2a74d2c64e94438dabe14ba65c21d35e/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.488395 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d691447d41407d88a45de3fa6f9a2d, user_id=2a74d2c64e94438dabe14ba65c21d35e, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.491060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.501396 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1402/2829] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:40 2022] PUT /identity/v3/projects/05d691447d41407d88a45de3fa6f9a2d/users/2a74d2c64e94438dabe14ba65c21d35e/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:40.512784 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.513141 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.513513 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.538793 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] MFA Rules not processed for user `2a74d2c64e94438dabe14ba65c21d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:40.539972 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:40.603235 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1428/2830] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:40.614649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.616423 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:40.671505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa939e-f979-4d15-9e03-8aca54ada58d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.675108 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356151b-2ba2-444e-990b-536b958f180a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.675738 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356151b-2ba2-444e-990b-536b958f180a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.676025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356151b-2ba2-444e-990b-536b958f180a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.676298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356151b-2ba2-444e-990b-536b958f180a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.684885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356151b-2ba2-444e-990b-536b958f180a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.686400 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356151b-2ba2-444e-990b-536b958f180a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.695424 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1403/2831] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:40.723081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.782775 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ebb10-0c3e-4139-887d-226e78935564 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:40.787322 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:40.788185 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.788462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.788728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] PATH_INFO: `/v3/users/87234d764b224e318d8460dd6fe0cea8` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.789937 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87234d764b224e318d8460dd6fe0cea8)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:40.791830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:40.835876 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87234d764b224e318d8460dd6fe0cea8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:40.836533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87234d764b224e318d8460dd6fe0cea8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:40.848569 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87234d764b224e318d8460dd6fe0cea8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:40.855188 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87234d764b224e318d8460dd6fe0cea8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:40.855883 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87234d764b224e318d8460dd6fe0cea8'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:40.868514 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1429/2832] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:40 2022] DELETE /identity/v3/users/87234d764b224e318d8460dd6fe0cea8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:40.873039 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:40.873330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:40.873608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:40.891086 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:40.892249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:40.947510 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1404/2833] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:40.957651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:40.959089 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:41.014563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a17ad7-5d0c-4b92-866b-c9b92de044e4 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:41.018295 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:41.018934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:41.019217 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:41.019493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:41.028198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:41.030302 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:41.039370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1430/2834] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:41.292949 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:41.294441 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:41.307124 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beecbf3-9a93-4b8d-85dc-662bcb83c252 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:41.311699 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:41.312968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:41.312968 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:41.313171 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] PATH_INFO: `/v3/projects/0d063aa51e3045b398a1b68a7709940f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:41.314464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d063aa51e3045b398a1b68a7709940f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:41.316237 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:41.360120 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d063aa51e3045b398a1b68a7709940f', 'request_id': 'req-2eafa68f-a5fd-406b-b712-e6441e02c016'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.365849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d063aa51e3045b398a1b68a7709940f', 'request_id': 'req-2eafa68f-a5fd-406b-b712-e6441e02c016'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.371043 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d063aa51e3045b398a1b68a7709940f', 'request_id': 'req-2eafa68f-a5fd-406b-b712-e6441e02c016'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.383085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] The token cache is being invalidate because project 0d063aa51e3045b398a1b68a7709940f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:41.383393 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.384011 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.385533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1405/2835] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:41 2022] DELETE /identity/v3/projects/0d063aa51e3045b398a1b68a7709940f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:41.389676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:41.398910 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a26e2-beeb-410f-b37f-95ffef3b718c service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:41.454161 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:41.455020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:41.455320 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:41.455572 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] PATH_INFO: `/v3/users/2a74d2c64e94438dabe14ba65c21d35e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:41.456768 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a74d2c64e94438dabe14ba65c21d35e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:41.458728 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:41.503627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a74d2c64e94438dabe14ba65c21d35e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.504464 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a74d2c64e94438dabe14ba65c21d35e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.515899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a74d2c64e94438dabe14ba65c21d35e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.522210 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a74d2c64e94438dabe14ba65c21d35e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.522835 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-9e794c35-121d-4f9c-9b1e-e77ae2789ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a74d2c64e94438dabe14ba65c21d35e'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.535177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1431/2836] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:41 2022] DELETE /identity/v3/users/2a74d2c64e94438dabe14ba65c21d35e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:41.798197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:41.799595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:41.813591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafa68f-a5fd-406b-b712-e6441e02c016 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:41.868758 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:41.869760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:41.870081 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:41.870359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] PATH_INFO: `/v3/projects/05d691447d41407d88a45de3fa6f9a2d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:41.871533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d691447d41407d88a45de3fa6f9a2d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:41.874427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:41.918788 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d691447d41407d88a45de3fa6f9a2d', 'request_id': 'req-e71f6069-d4db-45bb-b612-0211608282c2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.925062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d691447d41407d88a45de3fa6f9a2d', 'request_id': 'req-e71f6069-d4db-45bb-b612-0211608282c2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.930351 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d691447d41407d88a45de3fa6f9a2d', 'request_id': 'req-e71f6069-d4db-45bb-b612-0211608282c2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.942772 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] The token cache is being invalidate because project 05d691447d41407d88a45de3fa6f9a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:41.943062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.943688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e71f6069-d4db-45bb-b612-0211608282c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:41.945210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1406/2837] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:41 2022] DELETE /identity/v3/projects/05d691447d41407d88a45de3fa6f9a2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:41.950308 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:41.950603 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:41.951499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:41.970076 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:41.971272 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:42.029049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1432/2838] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:42.037094 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.037383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.037665 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.055692 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:42.056881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:42.066018 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1407/2839] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:42.070121 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.080014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1763-ddce-4b1d-9071-2659ecb7e938 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.084501 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.085140 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.085416 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.085684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.086435 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:42.086736 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.088307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.099344 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1433/2840] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 19:12:42.103468 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.113054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a412-dd0d-47f2-a5f5-d449c3ec9ddd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.117612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.118299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.118584 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.118863 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.119552 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.121432 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.150881 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1408/2841] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:42.151971 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.161756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f1b12-f6a4-45a4-8659-a500c0b792de admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.215857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.216914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.216914 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.217108 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.217756 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.219701 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.240277 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1434/2842] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:42.244422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.255338 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff96887-eb6d-4fa8-8f76-0e98120cb7d9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.259933 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.260578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.260861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.261139 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.261901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.263605 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.273715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1409/2843] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:42.277455 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.287307 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cffb9f-cee8-41e6-b6f5-b2c0bbce3bf4 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.291733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538004b-55df-40d3-ac99-3a6876791c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.292382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538004b-55df-40d3-ac99-3a6876791c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.292664 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538004b-55df-40d3-ac99-3a6876791c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.292940 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538004b-55df-40d3-ac99-3a6876791c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.293667 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538004b-55df-40d3-ac99-3a6876791c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.296127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538004b-55df-40d3-ac99-3a6876791c98 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.305934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1435/2844] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:42.309764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.319951 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7789c-c30a-4a0d-9a3f-02a107ba636c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.324447 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.325302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.325586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.325891 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] PATH_INFO: `/v3/projects/366c59db63ac4517b77b10d685f4c56c/users/3ca7f4ba05c34805b2380c5da5101d37/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.339631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=366c59db63ac4517b77b10d685f4c56c, user_id=3ca7f4ba05c34805b2380c5da5101d37, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.342279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.354211 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1410/2845] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:42 2022] PUT /identity/v3/projects/366c59db63ac4517b77b10d685f4c56c/users/3ca7f4ba05c34805b2380c5da5101d37/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:42.364710 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a38322-597c-47fc-908e-560321228079 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.365002 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a38322-597c-47fc-908e-560321228079 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.365281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a38322-597c-47fc-908e-560321228079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.391094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-e1a38322-597c-47fc-908e-560321228079 None None] MFA Rules not processed for user `3ca7f4ba05c34805b2380c5da5101d37`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:42.392258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e1a38322-597c-47fc-908e-560321228079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:42.454258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1436/2846] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:42.458893 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.518554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e0233-cd09-478c-9f7e-1c25c4fb9fbf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.523131 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.523779 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.524060 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.524330 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.525008 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.526925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.551791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1411/2847] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:42.556142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a38322-597c-47fc-908e-560321228079 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.566475 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a38322-597c-47fc-908e-560321228079 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.620402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.621059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.621340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.621615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.622341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.624333 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.643365 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1437/2848] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:42.647290 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.657847 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb0e2-1c12-46d4-bf0f-312f2f5e8ec4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.662482 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.663138 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.663448 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.663732 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.664455 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.666104 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.676472 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1412/2849] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:42.680480 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.690512 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ea99-e7ab-482a-97f7-91c96e545141 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.695007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.695865 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.696143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.696415 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] PATH_INFO: `/v3/projects/e007590d7f8c4b4890b802a592370d6f/users/5e1bd59b89404f039cbc1a7457ccee17/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.711124 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e007590d7f8c4b4890b802a592370d6f, user_id=5e1bd59b89404f039cbc1a7457ccee17, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.713724 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.725764 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1438/2850] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:42 2022] PUT /identity/v3/projects/e007590d7f8c4b4890b802a592370d6f/users/5e1bd59b89404f039cbc1a7457ccee17/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:42.729660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.739481 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174454-f306-40e5-9022-9ee8f07b173c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.794091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c68fe7-4321-4338-ab4f-bf032b93f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.794835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68fe7-4321-4338-ab4f-bf032b93f1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.795083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68fe7-4321-4338-ab4f-bf032b93f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.795467 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68fe7-4321-4338-ab4f-bf032b93f1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.796195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c68fe7-4321-4338-ab4f-bf032b93f1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.797780 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c68fe7-4321-4338-ab4f-bf032b93f1c1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.807346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1413/2851] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:42.811943 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.821681 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7290c-5d98-4fd9-8010-8c95e37e5c16 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:42.826249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:42.827294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.827616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.827892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] PATH_INFO: `/v3/projects/e007590d7f8c4b4890b802a592370d6f/users/5e1bd59b89404f039cbc1a7457ccee17/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.829988 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e007590d7f8c4b4890b802a592370d6f, user_id=5e1bd59b89404f039cbc1a7457ccee17, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:42.832891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:42.843558 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1439/2852] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:42 2022] PUT /identity/v3/projects/e007590d7f8c4b4890b802a592370d6f/users/5e1bd59b89404f039cbc1a7457ccee17/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:42.855239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:42.855560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:42.855868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:42.882305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] MFA Rules not processed for user `5e1bd59b89404f039cbc1a7457ccee17`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:42.883491 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:42.948240 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1414/2853] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:42.959127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:42.960824 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:43.017262 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1844d-ad21-4ba5-83a5-0b54e82c479b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:43.020833 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:43.021467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:43.021750 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:43.022064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:43.031523 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:43.032939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:43.042229 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1440/2854] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:43.136889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:43.147051 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd2b6-542e-41c5-b709-493d1518e3a6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:43.150578 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68c4e7-70df-498f-8955-c07fcd2786b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:43.151199 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68c4e7-70df-498f-8955-c07fcd2786b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:43.151473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68c4e7-70df-498f-8955-c07fcd2786b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:43.151742 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68c4e7-70df-498f-8955-c07fcd2786b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:43.211046 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68c4e7-70df-498f-8955-c07fcd2786b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:43.212479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68c4e7-70df-498f-8955-c07fcd2786b2 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:43.222034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1415/2855] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:45.759661 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:45.818250 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7bf84-792b-4f59-a2f8-b05b6a72ca47 service cinder] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:45.822859 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:45.823718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:45.823996 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:45.824265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] PATH_INFO: `/v3/users/3ca7f4ba05c34805b2380c5da5101d37` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:45.825456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca7f4ba05c34805b2380c5da5101d37)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:45.827446 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:45.872742 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca7f4ba05c34805b2380c5da5101d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:45.873390 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca7f4ba05c34805b2380c5da5101d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:45.884815 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca7f4ba05c34805b2380c5da5101d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:45.891880 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca7f4ba05c34805b2380c5da5101d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:45.892508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca7f4ba05c34805b2380c5da5101d37'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:45.904565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1441/2856] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:45 2022] DELETE /identity/v3/users/3ca7f4ba05c34805b2380c5da5101d37 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:45.909701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:45.910214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:45.910299 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:45.927217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:45.928407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:45.986477 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1416/2857] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:45.996127 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:45.997516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:46.055152 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f318ab-25f5-4690-8ecb-4d6befc2ce27 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:46.058939 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:46.059590 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:46.059868 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:46.060138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:46.070075 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:46.071484 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:46.081170 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1442/2858] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:46.340557 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:46.342040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:46.353973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0fd33-4610-4a0f-8812-2693eda06a6a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:46.358542 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:46.359337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:46.359612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:46.359885 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] PATH_INFO: `/v3/projects/366c59db63ac4517b77b10d685f4c56c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:46.361107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=366c59db63ac4517b77b10d685f4c56c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:46.362995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:46.408197 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366c59db63ac4517b77b10d685f4c56c', 'request_id': 'req-365e81d0-32de-46bc-9e1f-149237a0cb1e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.413969 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366c59db63ac4517b77b10d685f4c56c', 'request_id': 'req-365e81d0-32de-46bc-9e1f-149237a0cb1e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.419305 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366c59db63ac4517b77b10d685f4c56c', 'request_id': 'req-365e81d0-32de-46bc-9e1f-149237a0cb1e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.431569 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] The token cache is being invalidate because project 366c59db63ac4517b77b10d685f4c56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:46.431856 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.432459 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.434015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1417/2859] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:46 2022] DELETE /identity/v3/projects/366c59db63ac4517b77b10d685f4c56c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:46.438693 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:46.448110 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b415000-4483-4948-a3e4-d0440c4517dd service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:46.503629 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:46.504757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:46.505040 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:46.505315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] PATH_INFO: `/v3/users/5e1bd59b89404f039cbc1a7457ccee17` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:46.506510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1bd59b89404f039cbc1a7457ccee17)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:46.508411 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:46.554281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1bd59b89404f039cbc1a7457ccee17'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.554947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1bd59b89404f039cbc1a7457ccee17'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.566951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1bd59b89404f039cbc1a7457ccee17'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.573666 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1bd59b89404f039cbc1a7457ccee17'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.574362 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-b47deeba-53c6-4e09-8ee4-907362bf3980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1bd59b89404f039cbc1a7457ccee17'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.587047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1443/2860] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:46 2022] DELETE /identity/v3/users/5e1bd59b89404f039cbc1a7457ccee17 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:46.846657 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:46.848175 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:46.862576 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e81d0-32de-46bc-9e1f-149237a0cb1e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:46.918034 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:46.918886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:46.919166 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:46.919440 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] PATH_INFO: `/v3/projects/e007590d7f8c4b4890b802a592370d6f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:46.920595 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e007590d7f8c4b4890b802a592370d6f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:46.923157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:46.967603 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e007590d7f8c4b4890b802a592370d6f', 'request_id': 'req-118c86df-7571-4aa2-b461-6d3b10b34494'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.973844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e007590d7f8c4b4890b802a592370d6f', 'request_id': 'req-118c86df-7571-4aa2-b461-6d3b10b34494'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.979040 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e007590d7f8c4b4890b802a592370d6f', 'request_id': 'req-118c86df-7571-4aa2-b461-6d3b10b34494'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.991999 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] The token cache is being invalidate because project e007590d7f8c4b4890b802a592370d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:46.992284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.992904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-118c86df-7571-4aa2-b461-6d3b10b34494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:46.994495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1418/2861] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:46 2022] DELETE /identity/v3/projects/e007590d7f8c4b4890b802a592370d6f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:47.000024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.000485 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.000685 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.018588 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:47.019766 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:47.077294 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1444/2862] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:12:47.084702 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.084987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.085264 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.103331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:47.104434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:47.112789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1419/2863] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:47.116869 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.126413 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75530409-5883-4f13-8b82-8ebd7a775629 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.131252 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.131900 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.132182 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.132462 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] PATH_INFO: `/v3/domains` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.133218 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79983) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:47.133527 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.135143 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.146616 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1445/2864] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:12:47.150632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.160083 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a74e-5834-42a5-9b38-121a0d8d81c4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.164581 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.165214 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.165493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.165764 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.166479 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.168418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.193359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1420/2865] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:47.197407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.207271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c6ddc-58a7-4d91-988c-0e657efed694 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.262382 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.263038 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.263315 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.263582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.264263 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.266816 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.285437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1446/2866] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:47.289414 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.299705 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f17bf1-06bf-4b0e-bb7e-e483112f59e8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.304191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.304831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.305109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.305381 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.306163 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.307737 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.318439 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1421/2867] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:47.322115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.332078 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210768-923c-43c3-9063-47c3b796ff66 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.336670 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0781d5-a3e8-431d-84bb-345d30b747cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.337317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0781d5-a3e8-431d-84bb-345d30b747cc admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.337599 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0781d5-a3e8-431d-84bb-345d30b747cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.337899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0781d5-a3e8-431d-84bb-345d30b747cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.338620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0781d5-a3e8-431d-84bb-345d30b747cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.340194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0781d5-a3e8-431d-84bb-345d30b747cc admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.350594 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1447/2868] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:47.354564 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.364980 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19544-b8cb-45ed-96d8-0ea8100448e9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.369452 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.370337 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.370618 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.370890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] PATH_INFO: `/v3/projects/24a478b4bff34ed697bb0b481a78d38c/users/bc7967c5288c439cb110bfc7d0687c26/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.384855 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a478b4bff34ed697bb0b481a78d38c, user_id=bc7967c5288c439cb110bfc7d0687c26, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.387524 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.401022 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1422/2869] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:47 2022] PUT /identity/v3/projects/24a478b4bff34ed697bb0b481a78d38c/users/bc7967c5288c439cb110bfc7d0687c26/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:47.412434 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.412725 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.413007 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.439271 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] MFA Rules not processed for user `bc7967c5288c439cb110bfc7d0687c26`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:47.440454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:47.506445 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1448/2870] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:47.510890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.571615 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e809370-caa3-47c2-aee0-afc28ccf1aa1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.576134 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.576781 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.577062 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.577911 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.578626 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.580493 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.604757 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1423/2871] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:47.608854 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.619200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98725-4cf2-44ff-a00b-47000187048c None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.674808 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.675476 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.675787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.676063 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] PATH_INFO: `/v3/users` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.676770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.678716 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.697635 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1449/2872] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:47.701591 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.712348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65617043-d0ff-4802-9eb9-2bf900bb0120 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.716925 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.717609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.718566 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.718851 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.719729 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.721377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.731586 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1424/2873] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:47.735733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.745817 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6c42f-7e21-49a3-995c-085628f82d0d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.751289 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.752167 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.752451 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.752734 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] PATH_INFO: `/v3/projects/0372ef91dcc0401cbc21f52d47624f42/users/25d5be55cd8742eea367299273237618/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.768887 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0372ef91dcc0401cbc21f52d47624f42, user_id=25d5be55cd8742eea367299273237618, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.771613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.784002 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1450/2874] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:47 2022] PUT /identity/v3/projects/0372ef91dcc0401cbc21f52d47624f42/users/25d5be55cd8742eea367299273237618/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:47.788020 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.797831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562581-bc48-4057-b022-bbe1338d0780 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.851673 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0e5b-6cb6-4c16-b560-a9ab3073cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.852332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0e5b-6cb6-4c16-b560-a9ab3073cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.852638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0e5b-6cb6-4c16-b560-a9ab3073cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.852913 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0e5b-6cb6-4c16-b560-a9ab3073cbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.853647 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0e5b-6cb6-4c16-b560-a9ab3073cbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.855559 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0e5b-6cb6-4c16-b560-a9ab3073cbb1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.865092 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1425/2875] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:47.869248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:47.880147 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2073-e03c-443e-9a91-6440880e711a admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:47.884680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:47.885540 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.885842 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.886116 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] PATH_INFO: `/v3/projects/0372ef91dcc0401cbc21f52d47624f42/users/25d5be55cd8742eea367299273237618/roles/86c6955a20734baf912fede27a24309e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.888046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0372ef91dcc0401cbc21f52d47624f42, user_id=25d5be55cd8742eea367299273237618, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:47.891437 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:47.901135 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1451/2876] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:47 2022] PUT /identity/v3/projects/0372ef91dcc0401cbc21f52d47624f42/users/25d5be55cd8742eea367299273237618/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:47.912266 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:47.912554 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:47.912831 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:47.939229 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] MFA Rules not processed for user `25d5be55cd8742eea367299273237618`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:47.940413 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:48.005195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1426/2877] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:48.016379 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:48.018122 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:48.072268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a34c54-d91f-4314-b008-1cadad19f83d admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:48.075872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc6b5-1c54-4e08-94e3-d1f551e88dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:48.076500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc6b5-1c54-4e08-94e3-d1f551e88dec service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:48.076780 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc6b5-1c54-4e08-94e3-d1f551e88dec service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:48.077050 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc6b5-1c54-4e08-94e3-d1f551e88dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:48.086507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc6b5-1c54-4e08-94e3-d1f551e88dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:48.087911 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc6b5-1c54-4e08-94e3-d1f551e88dec service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:48.097564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1452/2878] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:12:48.224182 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:48.284019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586c1a-8c2c-492d-a832-9cf9fcdf5e9a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:48.288407 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:48.289258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:48.289534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:48.289817 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] PATH_INFO: `/v3/users/bc7967c5288c439cb110bfc7d0687c26` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:48.290989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7967c5288c439cb110bfc7d0687c26)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:48.292882 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:48.337187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7967c5288c439cb110bfc7d0687c26'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.337869 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7967c5288c439cb110bfc7d0687c26'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.349314 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7967c5288c439cb110bfc7d0687c26'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.355808 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7967c5288c439cb110bfc7d0687c26'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.356438 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7967c5288c439cb110bfc7d0687c26'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.369186 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1427/2879] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:48 2022] DELETE /identity/v3/users/bc7967c5288c439cb110bfc7d0687c26 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:48.373618 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:48.373961 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:48.374452 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:48.392830 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:48.394059 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:48.450269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1453/2880] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:48.460789 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:48.462248 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:48.518215 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752198f-f57e-4570-8e25-e8b26704d639 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:48.521819 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:48.522465 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:48.522751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:48.523031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:48.532706 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:48.534189 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:48.543315 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1428/2881] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:48.802491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:48.803970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:48.816498 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53eaf9-6e15-45a8-9802-110aa69ebc53 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:48.821101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:48.821977 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:48.822254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:48.822526 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] PATH_INFO: `/v3/projects/24a478b4bff34ed697bb0b481a78d38c` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:48.823675 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a478b4bff34ed697bb0b481a78d38c)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:48.825539 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:48.872043 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a478b4bff34ed697bb0b481a78d38c', 'request_id': 'req-ce3fd420-e121-43c5-b2b6-902a0e3d6265'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.878623 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a478b4bff34ed697bb0b481a78d38c', 'request_id': 'req-ce3fd420-e121-43c5-b2b6-902a0e3d6265'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.884259 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a478b4bff34ed697bb0b481a78d38c', 'request_id': 'req-ce3fd420-e121-43c5-b2b6-902a0e3d6265'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.896101 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] The token cache is being invalidate because project 24a478b4bff34ed697bb0b481a78d38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:48.896389 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.897094 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:48.898773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1454/2882] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:48 2022] DELETE /identity/v3/projects/24a478b4bff34ed697bb0b481a78d38c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:48.902670 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:48.912136 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cfdf-fdaf-4c8c-9591-74ca573c53d5 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:48.965889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:48.966787 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:48.967070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:48.967346 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] PATH_INFO: `/v3/users/25d5be55cd8742eea367299273237618` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:48.968698 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d5be55cd8742eea367299273237618)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:48.970631 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.015225 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d5be55cd8742eea367299273237618'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.015870 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d5be55cd8742eea367299273237618'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.027217 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d5be55cd8742eea367299273237618'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.034411 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d5be55cd8742eea367299273237618'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.035054 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c5136e5a-aa2a-496d-8b84-f23280f9670b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d5be55cd8742eea367299273237618'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.047919 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1429/2883] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:48 2022] DELETE /identity/v3/users/25d5be55cd8742eea367299273237618 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:49.308857 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.310357 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:49.323425 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fd420-e121-43c5-b2b6-902a0e3d6265 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.379560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.380410 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.380684 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.380951 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] PATH_INFO: `/v3/projects/0372ef91dcc0401cbc21f52d47624f42` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.382125 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0372ef91dcc0401cbc21f52d47624f42)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.383994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.427073 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0372ef91dcc0401cbc21f52d47624f42', 'request_id': 'req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.432707 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0372ef91dcc0401cbc21f52d47624f42', 'request_id': 'req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.438300 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0372ef91dcc0401cbc21f52d47624f42', 'request_id': 'req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.449564 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] The token cache is being invalidate because project 0372ef91dcc0401cbc21f52d47624f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:12:49.449881 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.450494 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-98e7f1b3-a015-4e5f-9eed-ba02c88653fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:49.451997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1455/2884] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:12:49 2022] DELETE /identity/v3/projects/0372ef91dcc0401cbc21f52d47624f42 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:49.457089 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.457385 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.457666 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.476023 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:49.477201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:49.534091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1430/2885] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:12:49.541773 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.542088 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.542361 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.560983 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:49.562203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:49.569888 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1456/2886] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:49.573861 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.583609 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba5562-20d7-473b-870d-86fcfabbd830 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.588070 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.588709 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.588985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.589254 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.590015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:12:49.590317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.591889 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.604239 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1431/2887] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 19:12:49.608474 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.618799 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401fab-4368-4aaf-972a-177310cb5c00 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.623349 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.623992 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.624273 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.624546 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.625714 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.627627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.653061 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1457/2888] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:49.657818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.667272 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac0d3c-eff2-4e8e-9b1b-59a5aed3bff5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.720560 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.721143 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.721421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.721690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.722449 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.724350 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.743901 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1432/2889] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:49 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:12:49.748524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.759505 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704656cf-d974-4022-9080-f4da0c898c7b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.764328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.765025 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.765341 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.766153 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.767222 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.768968 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.779790 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1458/2890] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:49.784641 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.794760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52c5ed-ab89-41ff-bd0f-73d48c5e40e4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.799418 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd60dc-1565-4a28-b8cd-dad8e703c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.800066 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd60dc-1565-4a28-b8cd-dad8e703c10e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.800348 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd60dc-1565-4a28-b8cd-dad8e703c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.800733 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd60dc-1565-4a28-b8cd-dad8e703c10e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.801457 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd60dc-1565-4a28-b8cd-dad8e703c10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.803076 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd60dc-1565-4a28-b8cd-dad8e703c10e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.812694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1433/2891] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:49.816662 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:49.826104 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd776b9-52e6-402f-8006-2c6a94309922 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:49.831377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:49.832249 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.832532 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.832805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] PATH_INFO: `/v3/projects/de34072f48984db2924f8d3f746eaebd/users/bc8f8996dcb24c68b6a5609e81668bc1/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.847391 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de34072f48984db2924f8d3f746eaebd, user_id=bc8f8996dcb24c68b6a5609e81668bc1, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:49.850047 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:49.862619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1459/2892] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:49 2022] PUT /identity/v3/projects/de34072f48984db2924f8d3f746eaebd/users/bc8f8996dcb24c68b6a5609e81668bc1/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:49.873707 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:49.874032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:49.874317 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:49.900769 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] MFA Rules not processed for user `bc8f8996dcb24c68b6a5609e81668bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:49.902005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:49.965287 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1434/2893] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:49.970733 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.030682 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ecd0-dc9b-4fe9-adda-502f97ada21f admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.035530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.036180 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.036466 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.036741 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.037438 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.039370 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.064096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1460/2894] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:12:49 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:50.068323 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.079555 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb7d51-a4c5-4fd3-8b39-4d81f26b4c91 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.132548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.133208 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.133494 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.133778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.134480 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.136395 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.156095 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1435/2895] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:12:50 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:12:50.160195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.170237 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a39c29-8a17-4271-8bc0-cbee8628b0e8 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.175014 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.175663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.175944 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.176225 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.176938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.178551 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.189195 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1461/2896] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:50.193246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.203019 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccd838-4322-424e-a36c-34d642accb2e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.208653 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.209517 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.209850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.210130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] PATH_INFO: `/v3/projects/abf9a90c14e240bdb0a4b3da3f1822ee/users/a4ef8cdc13e9480bb2374842441e1a18/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.224613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf9a90c14e240bdb0a4b3da3f1822ee, user_id=a4ef8cdc13e9480bb2374842441e1a18, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.227218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.240703 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1436/2897] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:50 2022] PUT /identity/v3/projects/abf9a90c14e240bdb0a4b3da3f1822ee/users/a4ef8cdc13e9480bb2374842441e1a18/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:12:50.244651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.255138 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510392f-9cb9-44da-a25f-6ed4d06c71ce admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.309093 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8403f-b225-4b37-a73b-f9ef9ddeec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.309751 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8403f-b225-4b37-a73b-f9ef9ddeec4c admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.310069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8403f-b225-4b37-a73b-f9ef9ddeec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.310347 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8403f-b225-4b37-a73b-f9ef9ddeec4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.311064 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8403f-b225-4b37-a73b-f9ef9ddeec4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.313142 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8403f-b225-4b37-a73b-f9ef9ddeec4c admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.322508 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1462/2898] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:12:50.326664 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.337277 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939f31-2800-4896-95b0-2264ec2c3da3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.341907 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.342810 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.343091 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.343371 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] PATH_INFO: `/v3/projects/abf9a90c14e240bdb0a4b3da3f1822ee/users/a4ef8cdc13e9480bb2374842441e1a18/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.345359 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf9a90c14e240bdb0a4b3da3f1822ee, user_id=a4ef8cdc13e9480bb2374842441e1a18, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.348017 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.357746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1437/2899] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:12:50 2022] PUT /identity/v3/projects/abf9a90c14e240bdb0a4b3da3f1822ee/users/a4ef8cdc13e9480bb2374842441e1a18/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:50.368091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.368383 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.368663 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.394533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] MFA Rules not processed for user `a4ef8cdc13e9480bb2374842441e1a18`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:50.395718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:50.460761 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1463/2900] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:50.471412 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:50.473144 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:50.528649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437be33-ec4d-417b-a1f9-36fe4936175b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:50.532218 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:50.532850 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:50.533137 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:50.533410 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:50.586074 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:50.587492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:50.596005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1438/2901] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:54.709194 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:54.710627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:54.722712 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87922a9-d6e3-4f10-8a05-c000e7cf823b None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:54.726260 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52395584-0465-4e3e-a429-cd5b1a8baca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:54.726898 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52395584-0465-4e3e-a429-cd5b1a8baca7 service cinder] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:54.727181 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52395584-0465-4e3e-a429-cd5b1a8baca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:54.727459 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52395584-0465-4e3e-a429-cd5b1a8baca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:54.736783 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52395584-0465-4e3e-a429-cd5b1a8baca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:54.738246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52395584-0465-4e3e-a429-cd5b1a8baca7 service cinder] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:54.747360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1464/2902] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:12:59.571596 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:59.631759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b436-9c2c-47ca-9c3f-62f0b1be68c3 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:59.636250 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:59.637100 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:59.637379 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:59.637652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] PATH_INFO: `/v3/users/bc8f8996dcb24c68b6a5609e81668bc1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:59.638846 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8f8996dcb24c68b6a5609e81668bc1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:59.640739 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:59.684176 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8f8996dcb24c68b6a5609e81668bc1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:59.684818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8f8996dcb24c68b6a5609e81668bc1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:59.696690 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8f8996dcb24c68b6a5609e81668bc1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:59.703561 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8f8996dcb24c68b6a5609e81668bc1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:59.704383 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8f8996dcb24c68b6a5609e81668bc1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:12:59.716608 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1439/2903] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:12:59 2022] DELETE /identity/v3/users/bc8f8996dcb24c68b6a5609e81668bc1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:12:59.721884 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:59.722406 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:59.722500 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:59.740396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:12:59.741574 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:59.803246 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1465/2904] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:12:59.812701 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:12:59.814746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:12:59.869506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbef2-0d85-47ea-b81f-d65d53fbad66 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:12:59.873077 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:12:59.873712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:12:59.874033 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:12:59.874311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:12:59.884049 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:12:59.885470 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:12:59.895223 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1440/2905] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:00.151676 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:00.153158 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:00.165328 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665be1-0666-4cbf-8eb9-9b4cd1a5e125 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:00.170323 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:00.171297 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.172306 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.173269 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] PATH_INFO: `/v3/projects/de34072f48984db2924f8d3f746eaebd` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.174748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de34072f48984db2924f8d3f746eaebd)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:00.176639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:00.221586 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de34072f48984db2924f8d3f746eaebd', 'request_id': 'req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.227502 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de34072f48984db2924f8d3f746eaebd', 'request_id': 'req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.232691 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de34072f48984db2924f8d3f746eaebd', 'request_id': 'req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.244449 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] The token cache is being invalidate because project de34072f48984db2924f8d3f746eaebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:13:00.244729 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.245334 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.246872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1466/2906] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:13:00 2022] DELETE /identity/v3/projects/de34072f48984db2924f8d3f746eaebd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:13:00.251612 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:00.261622 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76755756-a610-4948-a09d-04323cc1a485 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:00.315376 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:00.316231 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.316508 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.316778 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] PATH_INFO: `/v3/users/a4ef8cdc13e9480bb2374842441e1a18` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.317965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ef8cdc13e9480bb2374842441e1a18)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:00.319849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:00.364421 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ef8cdc13e9480bb2374842441e1a18'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.365063 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ef8cdc13e9480bb2374842441e1a18'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.376829 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ef8cdc13e9480bb2374842441e1a18'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.383522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ef8cdc13e9480bb2374842441e1a18'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.384154 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4bbb0189-96dc-4423-b47c-17ae7fb114ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ef8cdc13e9480bb2374842441e1a18'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.396279 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1441/2907] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:13:00 2022] DELETE /identity/v3/users/a4ef8cdc13e9480bb2374842441e1a18 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:13:00.658934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:00.660448 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:00.674151 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25722e-d2b8-4b9d-b7e9-5f7933815b7b admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:00.729456 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:00.730339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.730619 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.730891 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] PATH_INFO: `/v3/projects/abf9a90c14e240bdb0a4b3da3f1822ee` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.732054 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf9a90c14e240bdb0a4b3da3f1822ee)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:00.733978 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:00.777454 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf9a90c14e240bdb0a4b3da3f1822ee', 'request_id': 'req-63906c88-c04b-4e87-8096-1e03b32cd4bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.783723 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf9a90c14e240bdb0a4b3da3f1822ee', 'request_id': 'req-63906c88-c04b-4e87-8096-1e03b32cd4bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.788938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf9a90c14e240bdb0a4b3da3f1822ee', 'request_id': 'req-63906c88-c04b-4e87-8096-1e03b32cd4bd'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.801067 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] The token cache is being invalidate because project abf9a90c14e240bdb0a4b3da3f1822ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79983) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:13:00.801372 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.802020 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-63906c88-c04b-4e87-8096-1e03b32cd4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:13:00.803533 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1467/2908] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:13:00 2022] DELETE /identity/v3/projects/abf9a90c14e240bdb0a4b3da3f1822ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:13:00.809529 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.810006 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.810113 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.827941 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:13:00.829646 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:00.887085 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1442/2909] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:13:00.896049 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.896337 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.896611 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.914118 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:13:00.915293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:00.923620 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1468/2910] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:13:00.927571 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:00.936853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093f25-76fc-4ef9-a5bd-c9acb8243c59 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:00.942050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:00.942711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.942973 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.943249 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.943970 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 19:13:00.944273 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:00.945879 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:00.957050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1443/2911] 10.222.0.84 () {58 vars in 1152 bytes} [Fri May 13 19:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 19:13:00.961396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:00.970698 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9bc6c-8468-4505-b0c9-91dd77ccb077 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:00.975223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:00.975858 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:00.976136 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:00.976407 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:00.977223 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:00.979011 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:01.004458 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1469/2912] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:13:00 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:13:01.008723 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:01.018634 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d87f4-bd5c-49f7-b97e-630e70907097 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:01.072613 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:01.073268 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:01.073545 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:01.073844 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:01.074516 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:01.076397 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:01.095035 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1444/2913] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:13:01 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 19:13:01.099069 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:01.108899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69616-6075-4971-996b-da6a95f19618 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:01.114091 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:01.114737 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:01.115018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:01.115292 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:01.116012 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:01.117578 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:01.128207 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1470/2914] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:13:01.132415 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:01.142332 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1eb6-b7ff-4edc-9210-ed1b941b47d4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:01.146985 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290605a-c9e1-475f-8ee8-491518f5aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:01.147632 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290605a-c9e1-475f-8ee8-491518f5aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:01.147916 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290605a-c9e1-475f-8ee8-491518f5aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:01.148195 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290605a-c9e1-475f-8ee8-491518f5aec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:01.148921 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290605a-c9e1-475f-8ee8-491518f5aec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:01.150548 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290605a-c9e1-475f-8ee8-491518f5aec4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:01.160325 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1445/2915] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:13:01.164203 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:01.174478 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e16665-f161-4859-8010-44c775ab1920 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:01.178963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:01.179827 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:01.180103 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:01.180377 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] PATH_INFO: `/v3/projects/54cd196883524a00a765c0ff0dd58ab7/users/a56a7c344a604806bdf48a5d4cd50a3a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:01.194809 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cd196883524a00a765c0ff0dd58ab7, user_id=a56a7c344a604806bdf48a5d4cd50a3a, role_id=f02eb0a3ac994ebe8b0e1c9f167d281e)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:01.197409 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:01.210787 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1471/2916] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:13:01 2022] PUT /identity/v3/projects/54cd196883524a00a765c0ff0dd58ab7/users/a56a7c344a604806bdf48a5d4cd50a3a/roles/f02eb0a3ac994ebe8b0e1c9f167d281e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 19:13:01.215718 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bbe7-10cc-4fd3-8a89-f484da6fb4f4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:01.216015 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bbe7-10cc-4fd3-8a89-f484da6fb4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:01.216296 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bbe7-10cc-4fd3-8a89-f484da6fb4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:01.234103 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7bc3bbe7-10cc-4fd3-8a89-f484da6fb4f4 None None] MFA Rules not processed for user `ec0fceb9f1a04ac58d3b3075178f7b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:13:01.236107 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7bc3bbe7-10cc-4fd3-8a89-f484da6fb4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:01.291534 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1446/2917] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:13:01.301825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:01.303495 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:01.358339 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954526-8053-4498-bbfd-9c12137a87ac admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:01.362702 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:01.363366 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:01.363641 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:01.363917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:01.372524 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:01.373963 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:01.383511 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1472/2918] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:05.302098 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.302617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.302617 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.334522 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] MFA Rules not processed for user `a56a7c344a604806bdf48a5d4cd50a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:13:05.336284 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:05.399533 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1447/2919] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:13:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:13:05.404356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:05.415970 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24c21e-966c-4b28-a553-52cc79af46f7 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:05.420506 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:05.421397 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.421680 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.422070 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.422913 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:05.425046 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:05.452031 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1473/2920] 10.222.0.84 () {60 vars in 1152 bytes} [Fri May 13 19:13:05 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:13:05.457115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:05.470157 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e1a44-68f2-460e-b94d-2d01ebed40f0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:05.552991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:05.553572 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.553890 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.554168 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.554853 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:05.556759 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:05.577712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1448/2921] 10.222.0.84 () {60 vars in 1143 bytes} [Fri May 13 19:13:05 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 19:13:05.582213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:05.593123 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927e0ee-7450-4111-a74d-65d711920b1e admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:05.598879 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:05.599563 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.599848 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.600128 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.600866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:05.602530 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:05.615380 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1474/2922] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:13:05.620088 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:05.631489 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2621a-0ac4-4cbc-ae79-8970d147764c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:05.636181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:05.637044 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.637331 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.637610 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] PATH_INFO: `/v3/projects/982cf7012aef410ea88608b3ee44cb96/users/e95f0d4298e84247a4ac9263d1eb2912/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.654298 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982cf7012aef410ea88608b3ee44cb96, user_id=e95f0d4298e84247a4ac9263d1eb2912, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:05.656959 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:05.673894 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1449/2923] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:13:05 2022] PUT /identity/v3/projects/982cf7012aef410ea88608b3ee44cb96/users/e95f0d4298e84247a4ac9263d1eb2912/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:13:05.675179 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:05.685261 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa1da-3d80-464e-9af1-284510624463 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:05.742934 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6d1c0-8cdb-41f4-865e-923c371701e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:05.743615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d1c0-8cdb-41f4-865e-923c371701e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.743899 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d1c0-8cdb-41f4-865e-923c371701e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.744177 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6d1c0-8cdb-41f4-865e-923c371701e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.744909 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d1c0-8cdb-41f4-865e-923c371701e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:05.746579 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6d1c0-8cdb-41f4-865e-923c371701e5 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:05.761062 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1475/2924] 10.222.0.84 () {58 vars in 1121 bytes} [Fri May 13 19:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 19:13:05.762422 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:05.774258 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112318c-9d37-4c50-acbc-60e74ebb23b5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:05.779013 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:05.779914 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:05.780177 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:05.780451 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] PATH_INFO: `/v3/projects/982cf7012aef410ea88608b3ee44cb96/users/e95f0d4298e84247a4ac9263d1eb2912/roles/86c6955a20734baf912fede27a24309e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:05.782495 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982cf7012aef410ea88608b3ee44cb96, user_id=e95f0d4298e84247a4ac9263d1eb2912, role_id=86c6955a20734baf912fede27a24309e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:05.785123 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:05.795766 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1450/2925] 10.222.0.84 () {60 vars in 1482 bytes} [Fri May 13 19:13:05 2022] PUT /identity/v3/projects/982cf7012aef410ea88608b3ee44cb96/users/e95f0d4298e84247a4ac9263d1eb2912/roles/86c6955a20734baf912fede27a24309e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:13:10.206718 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8257-695f-4fe4-a45f-f50ba899dbb6 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:10.207220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8257-695f-4fe4-a45f-f50ba899dbb6 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:10.207385 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8257-695f-4fe4-a45f-f50ba899dbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:10.233651 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-f1fe8257-695f-4fe4-a45f-f50ba899dbb6 None None] MFA Rules not processed for user `e95f0d4298e84247a4ac9263d1eb2912`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:13:10.234805 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-f1fe8257-695f-4fe4-a45f-f50ba899dbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:10.301727 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1476/2926] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:13:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:13:10.317024 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:10.318963 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:10.421541 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7de40-8355-456d-8e80-95b8961f4178 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:10.429711 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:10.431080 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:10.431366 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:10.431640 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:10.492181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:10.493884 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:10.503712 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1451/2927] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:26.683643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:26.684159 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:26.684258 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:26.701493 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] MFA Rules not processed for user `a56a7c344a604806bdf48a5d4cd50a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:13:26.702700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:26.709966 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1477/2928] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:13:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:13:27.007883 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:27.068262 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18194c47-2425-49ab-a669-53b782e42d9d service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:27.071843 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:27.072473 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:27.072755 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:27.073031 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:27.074818 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:27.098210 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:27.099652 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:27.107625 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1452/2929] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:27.546265 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:27.547745 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:27.620319 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c603-2459-4875-90ef-f7e0eb183bf0 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:27.625281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:27.625969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:27.626254 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:27.627441 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:27.629281 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:27.641286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:27.643892 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:27.653752 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1478/2930] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:29.375694 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:29.377695 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:29.389505 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2c93-dd21-47e1-85a8-fe3d6ef25227 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:29.394801 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:29.395464 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:29.395753 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:29.396032 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:29.398549 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:29.410940 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:29.412434 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:29.421399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1453/2931] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:30.153155 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:30.155659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:30.177491 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f932-2767-4cee-b7a9-b0c010c82f13 service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:30.186947 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:30.187614 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:30.187921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:30.188198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:30.190810 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:30.205507 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:30.207198 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:30.218595 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1479/2932] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:40.997532 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:41.012021 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637f121-f064-4836-8edc-60465f171736 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:41.018492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:41.019190 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:41.019471 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:41.019746 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:41.021530 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:13:41.033688 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:41.035313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c453fc-9e98-4bb2-a623-f48f567ef94f service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:41.045776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1454/2933] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:13:42.984096 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:13:42.993356 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52525f3-ee1e-4c56-bbfd-8f53f604187d service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:13:42.997006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:13:42.997689 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:13:42.998001 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:13:42.998279 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:13:43.007762 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:13:43.009176 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:13:43.019317 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1480/2934] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:15:44.715773 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10405-8463-4b2f-87bb-ec0e13da92df None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:15:44.716274 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10405-8463-4b2f-87bb-ec0e13da92df None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:15:44.716367 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10405-8463-4b2f-87bb-ec0e13da92df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:15:44.733188 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-dec10405-8463-4b2f-87bb-ec0e13da92df None None] MFA Rules not processed for user `a56a7c344a604806bdf48a5d4cd50a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:15:44.734382 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dec10405-8463-4b2f-87bb-ec0e13da92df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:15:44.741061 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1455/2935] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:15:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:16:53.532018 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:16:53.543499 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73260cde-6ff0-4408-9e32-73dcc474dda5 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:16:53.548394 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:16:53.549026 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:16:53.549340 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:16:53.549615 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:16:53.551398 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:16:53.563311 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:16:53.564885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914caf33-6987-4cf8-aedd-e61c6cb37223 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:16:53.574866 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1481/2936] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:16:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:17:37.921427 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:37.922027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:37.922027 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:37.939592 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] MFA Rules not processed for user `a56a7c344a604806bdf48a5d4cd50a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:17:37.940886 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:37.947902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1456/2937] 10.222.0.84 () {58 vars in 957 bytes} [Fri May 13 19:17:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:17:37.983149 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721447-eebe-497a-9e91-cb66447c092e None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:37.983643 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721447-eebe-497a-9e91-cb66447c092e None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:37.983744 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721447-eebe-497a-9e91-cb66447c092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:38.041396 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-66721447-eebe-497a-9e91-cb66447c092e None None] MFA Rules not processed for user `a50eb00b59c3432bb7c085d3d8287ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:17:38.042700 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-66721447-eebe-497a-9e91-cb66447c092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:38.093402 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1482/2938] 10.222.0.84 () {58 vars in 1060 bytes} [Fri May 13 19:17:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:17:38.099684 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:17:38.109498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a9ebf-6cff-48ed-a6a8-2ce3066d3f5e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:17:38.113010 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50eb00b59c3432bb7c085d3d8287ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:17:38.113637 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:38.113956 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:38.114232 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:38.115950 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:38.129399 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:17:38.130910 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d099c1-d10c-4bab-a055-f89b77abfa89 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:17:38.142005 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1457/2939] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:17:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:17:38.834519 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] REQUEST_METHOD: `POST` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:38.834889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:38.835268 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:38.847347 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:38.847590 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:38.848429 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:38.872428 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.auth.core [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79983) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:17:38.873565 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:38.882065 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1483/2940] 10.222.0.84 () {58 vars in 1018 bytes} [Fri May 13 19:17:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:17:38.883984 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:17:38.885130 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:38.893201 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1458/2941] 10.222.0.84 () {58 vars in 1061 bytes} [Fri May 13 19:17:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 19:17:38.894660 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:17:38.895985 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:38.898835 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:17:38.906662 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f98c6-1c46-4d0f-b2c9-af5e027d032f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:17:38.909467 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e972bb0-7c30-4bb3-8350-42b639046da1 None None] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:17:38.910324 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:17:38.910947 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:38.911227 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:38.911498 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:38.913246 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:17:38.915516 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:17:38.916241 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:17:38.916522 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:17:38.916791 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:17:38.926053 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:17:38.927109 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:17:38.927627 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:17:38.928715 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5dd76-6d18-4d59-beee-f7ff3f7f70ac service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:17:38.938510 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1484/2942] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:17:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:17:38.940791 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1459/2943] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:17:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:18:39.256885 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:18:39.266354 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c3756-071a-4624-b07f-b8b6a150080e service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:18:39.269994 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:18:39.270967 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:18:39.271224 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:18:39.271490 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:18:39.279497 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:18:39.280917 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:18:39.288872 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1485/2944] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 19:19:23.296174 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:23.296650 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:23.296751 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:23.316577 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] MFA Rules not processed for user `5b6ddbd6cd3f4f238fb1a23a04a99401`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:19:23.317760 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:19:23.324128 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1460/2945] 10.222.0.84 () {58 vars in 1061 bytes} [Fri May 13 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:19:23.329997 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:23.338006 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06f64-a791-4b0a-b1bf-231b48e9a2f7 service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:23.341544 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:23.342200 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:23.342481 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:23.342757 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:23.350969 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:23.352381 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:23.361534 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1486/2946] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:19:24.458341 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:24.473842 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e8930-f390-4e0c-916f-16ccf7db63c0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:24.479868 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:24.480660 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:24.481125 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:24.481649 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:24.483604 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:19:24.497050 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:24.498750 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:24.510181 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1461/2947] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:19:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:19:26.884648 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:26.898582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257df6f-20e7-4e5c-8002-8202e3d2639c service neutron] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:26.903998 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e358b1f53b408f8f1e9661ac754c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:26.904639 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:26.904919 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:26.905193 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:26.916293 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:26.917895 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:26.929374 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1487/2948] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:19:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:19:36.662978 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:36.672995 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87d58d-1fde-4cd9-8ec7-573f93b9c07d service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:36.676667 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6ddbd6cd3f4f238fb1a23a04a99401', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:36.677302 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:36.677587 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:36.677904 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:36.735765 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:36.737187 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:36.746965 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1462/2949] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:19:43.103843 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:43.116613 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf15c4-0c90-4df1-9322-71ed9d94caaf service nova] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:43.121115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:43.122024 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:43.122304 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:43.122577 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] PATH_INFO: `/v3/users/a56a7c344a604806bdf48a5d4cd50a3a` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:43.123748 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56a7c344a604806bdf48a5d4cd50a3a)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:43.126213 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:43.173659 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56a7c344a604806bdf48a5d4cd50a3a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.174338 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56a7c344a604806bdf48a5d4cd50a3a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.185814 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56a7c344a604806bdf48a5d4cd50a3a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.192825 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56a7c344a604806bdf48a5d4cd50a3a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.193486 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56a7c344a604806bdf48a5d4cd50a3a'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.206220 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1488/2950] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:19:43 2022] DELETE /identity/v3/users/a56a7c344a604806bdf48a5d4cd50a3a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:19:43.374394 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:43.384991 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952ee00-a6f5-488e-b0ae-ef87fdf8fc83 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:43.440580 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:43.441430 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:43.441710 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:43.442025 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] PATH_INFO: `/v3/projects/54cd196883524a00a765c0ff0dd58ab7` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:43.443191 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cd196883524a00a765c0ff0dd58ab7)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:43.445079 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:43.489243 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cd196883524a00a765c0ff0dd58ab7', 'request_id': 'req-fbbb0701-82ce-4502-89ca-f8827bcb4c65'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.495150 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cd196883524a00a765c0ff0dd58ab7', 'request_id': 'req-fbbb0701-82ce-4502-89ca-f8827bcb4c65'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.501377 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cd196883524a00a765c0ff0dd58ab7', 'request_id': 'req-fbbb0701-82ce-4502-89ca-f8827bcb4c65'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.512902 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] The token cache is being invalidate because project 54cd196883524a00a765c0ff0dd58ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:19:43.513196 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.513987 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.515825 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1463/2951] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:19:43 2022] DELETE /identity/v3/projects/54cd196883524a00a765c0ff0dd58ab7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:19:43.519938 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:43.521343 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:19:43.534487 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3c0c6-fb20-402a-96d3-dd78cd3c1289 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:43.589326 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:43.590233 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:43.590509 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:43.590779 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] PATH_INFO: `/v3/users/e95f0d4298e84247a4ac9263d1eb2912` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:43.591956 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95f0d4298e84247a4ac9263d1eb2912)` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:43.594628 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:43.638746 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95f0d4298e84247a4ac9263d1eb2912'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.639392 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95f0d4298e84247a4ac9263d1eb2912'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.651889 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95f0d4298e84247a4ac9263d1eb2912'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.658834 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95f0d4298e84247a4ac9263d1eb2912'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.659471 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.notifications [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95f0d4298e84247a4ac9263d1eb2912'} {{(pid=79983) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.672168 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1489/2952] 10.222.0.84 () {58 vars in 1223 bytes} [Fri May 13 19:19:43 2022] DELETE /identity/v3/users/e95f0d4298e84247a4ac9263d1eb2912 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:19:43.839313 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:19:43.840811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:19:43.855874 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0701-82ce-4502-89ca-f8827bcb4c65 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:19:43.912638 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec0fceb9f1a04ac58d3b3075178f7b1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135c41fcf464430b5b4b85603ac96eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:19:43.913492 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:19:43.913811 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:19:43.914115 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] PATH_INFO: `/v3/projects/982cf7012aef410ea88608b3ee44cb96` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:19:43.915269 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=982cf7012aef410ea88608b3ee44cb96)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:19:43.917179 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:19:43.961536 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982cf7012aef410ea88608b3ee44cb96', 'request_id': 'req-d21888bf-f53b-4df3-963e-8b85d5c125fd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.967406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982cf7012aef410ea88608b3ee44cb96', 'request_id': 'req-d21888bf-f53b-4df3-963e-8b85d5c125fd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.972776 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982cf7012aef410ea88608b3ee44cb96', 'request_id': 'req-d21888bf-f53b-4df3-963e-8b85d5c125fd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.984849 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] The token cache is being invalidate because project 982cf7012aef410ea88608b3ee44cb96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 19:19:43.985311 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.985976 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d21888bf-f53b-4df3-963e-8b85d5c125fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 19:19:43.987506 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1464/2953] 10.222.0.84 () {58 vars in 1232 bytes} [Fri May 13 19:19:43 2022] DELETE /identity/v3/projects/982cf7012aef410ea88608b3ee44cb96 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 19:21:56.516008 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:21:56.517395 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:21:56.632726 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5822f-7ef6-4248-896e-3baffbfe2bd1 admin admin] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:21:56.688433 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:21:56.689004 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:21:56.689286 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:21:56.689560 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:21:56.691360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:21:56.702360 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:21:56.703921 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:21:56.713582 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1490/2954] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 19:22:56.498406 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0a04-08c7-4a8e-b9c8-2886780ec1ec None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:22:56.498989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0a04-08c7-4a8e-b9c8-2886780ec1ec None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:22:56.498989 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0a04-08c7-4a8e-b9c8-2886780ec1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:22:56.535183 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-054f0a04-08c7-4a8e-b9c8-2886780ec1ec None None] MFA Rules not processed for user `bf69e911e669406982a5943d7841993e`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 19:22:56.536387 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-054f0a04-08c7-4a8e-b9c8-2886780ec1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:22:56.555001 dv-cinder-839987-3-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1465/2955] 10.222.0.13 () {58 vars in 1015 bytes} [Fri May 13 19:22:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 19:22:56.566770 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] Authenticating user token {{(pid=79983) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 19:22:56.568115 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.fernet_utils [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79983) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 19:22:56.598183 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb84c5-7096-4e40-ba2e-6c2fd100aa98 service placement] Validating token access rules against request {{(pid=79983) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 19:22:56.603081 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9599-fec1-47fd-9700-bf5a299cfe53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69e911e669406982a5943d7841993e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31dac20388d84281bab425701bac98be', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79983) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 19:22:56.604483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9599-fec1-47fd-9700-bf5a299cfe53 service placement] REQUEST_METHOD: `GET` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 19:22:56.604483 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9599-fec1-47fd-9700-bf5a299cfe53 service placement] SCRIPT_NAME: `/identity` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 19:22:56.604767 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9599-fec1-47fd-9700-bf5a299cfe53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79983) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 19:22:56.612759 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9599-fec1-47fd-9700-bf5a299cfe53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 19:22:56.614352 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9599-fec1-47fd-9700-bf5a299cfe53 service placement] RBAC: Authorization granted {{(pid=79983) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 19:22:56.624248 dv-cinder-839987-3-iscsi devstack@keystone.service[79983]: [pid: 79983|app: 0|req: 1491/2956] 10.222.0.84 () {60 vars in 1365 bytes} [Fri May 13 19:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)